2023-02-07 14:02:36,620 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-07 14:02:36,670 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=237, ProcessCount=166, AvailableMemoryMB=6767 2023-02-07 14:02:36,930 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce 2023-02-07 14:02:36,937 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 14:02:36,938 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/cluster_a7113403-731d-7c1f-c69d-a97757e704e9, deleteOnExit=true 2023-02-07 14:02:36,938 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 14:02:36,938 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/test.cache.data in system properties and HBase conf 2023-02-07 14:02:36,939 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 14:02:36,939 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/hadoop.log.dir in system properties and HBase conf 2023-02-07 14:02:36,939 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 14:02:36,940 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 14:02:36,940 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 14:02:37,053 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-07 14:02:37,492 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 14:02:37,496 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:02:37,497 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:02:37,497 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 14:02:37,497 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:02:37,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 14:02:37,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 14:02:37,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:02:37,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:02:37,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 14:02:37,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/nfs.dump.dir in system properties and HBase conf 2023-02-07 14:02:37,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/java.io.tmpdir in system properties and HBase conf 2023-02-07 14:02:37,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:02:37,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 14:02:37,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 14:02:37,995 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:02:38,000 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:02:38,328 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-07 14:02:38,533 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-07 14:02:38,548 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:02:38,593 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:02:38,629 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/java.io.tmpdir/Jetty_localhost_33287_hdfs____.prydc5/webapp 2023-02-07 14:02:38,789 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33287 2023-02-07 14:02:38,802 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:02:38,802 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:02:39,350 WARN [Listener at localhost/37673] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:02:39,440 WARN [Listener at localhost/37673] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:02:39,461 WARN [Listener at localhost/37673] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:02:39,470 INFO [Listener at localhost/37673] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:02:39,480 INFO [Listener at localhost/37673] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/java.io.tmpdir/Jetty_localhost_38323_datanode____.x9qt0q/webapp 2023-02-07 14:02:39,660 INFO [Listener at localhost/37673] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38323 2023-02-07 14:02:40,058 WARN [Listener at localhost/35337] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:02:40,085 WARN [Listener at localhost/35337] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:02:40,102 WARN [Listener at localhost/35337] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:02:40,104 INFO [Listener at localhost/35337] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:02:40,114 INFO [Listener at localhost/35337] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/java.io.tmpdir/Jetty_localhost_34631_datanode____5m0tx6/webapp 2023-02-07 14:02:40,225 INFO [Listener at localhost/35337] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34631 2023-02-07 14:02:40,248 WARN [Listener at localhost/40837] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:02:40,599 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x31943b1c757c928: Processing first storage report for DS-28ff7299-5bb3-4a61-a833-4c1da79e189a from datanode 1a9472a0-e162-4184-a883-c1412cebad94 2023-02-07 14:02:40,602 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x31943b1c757c928: from storage DS-28ff7299-5bb3-4a61-a833-4c1da79e189a node DatanodeRegistration(127.0.0.1:37739, datanodeUuid=1a9472a0-e162-4184-a883-c1412cebad94, infoPort=46053, infoSecurePort=0, ipcPort=40837, storageInfo=lv=-57;cid=testClusterID;nsid=811633447;c=1675778558083), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-07 14:02:40,602 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8f86095e3c027f5e: Processing first storage report for DS-e388ac55-a8bf-4e47-b228-d4fb292540e6 from datanode 35fbf38b-0cef-4f8b-920b-61a3c6a0b37f 2023-02-07 14:02:40,602 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8f86095e3c027f5e: from storage DS-e388ac55-a8bf-4e47-b228-d4fb292540e6 node DatanodeRegistration(127.0.0.1:33671, datanodeUuid=35fbf38b-0cef-4f8b-920b-61a3c6a0b37f, infoPort=38953, infoSecurePort=0, ipcPort=35337, storageInfo=lv=-57;cid=testClusterID;nsid=811633447;c=1675778558083), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:02:40,602 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x31943b1c757c928: Processing first storage report for DS-9ec2ba9d-c046-4e06-b913-10340540606e from datanode 1a9472a0-e162-4184-a883-c1412cebad94 2023-02-07 14:02:40,602 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x31943b1c757c928: from storage DS-9ec2ba9d-c046-4e06-b913-10340540606e node DatanodeRegistration(127.0.0.1:37739, datanodeUuid=1a9472a0-e162-4184-a883-c1412cebad94, infoPort=46053, infoSecurePort=0, ipcPort=40837, storageInfo=lv=-57;cid=testClusterID;nsid=811633447;c=1675778558083), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:02:40,603 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8f86095e3c027f5e: Processing first storage report for DS-fd39e1cb-cac6-412e-af0a-98c5af7cfff0 from datanode 35fbf38b-0cef-4f8b-920b-61a3c6a0b37f 2023-02-07 14:02:40,603 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8f86095e3c027f5e: from storage DS-fd39e1cb-cac6-412e-af0a-98c5af7cfff0 node DatanodeRegistration(127.0.0.1:33671, datanodeUuid=35fbf38b-0cef-4f8b-920b-61a3c6a0b37f, infoPort=38953, infoSecurePort=0, ipcPort=35337, storageInfo=lv=-57;cid=testClusterID;nsid=811633447;c=1675778558083), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:02:40,768 DEBUG [Listener at localhost/40837] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce 2023-02-07 14:02:40,856 INFO [Listener at localhost/40837] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/cluster_a7113403-731d-7c1f-c69d-a97757e704e9/zookeeper_0, clientPort=55354, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/cluster_a7113403-731d-7c1f-c69d-a97757e704e9/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/cluster_a7113403-731d-7c1f-c69d-a97757e704e9/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 14:02:40,874 INFO [Listener at localhost/40837] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55354 2023-02-07 14:02:40,882 INFO [Listener at localhost/40837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:40,884 INFO [Listener at localhost/40837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:41,557 INFO [Listener at localhost/40837] util.FSUtils(479): Created version file at hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d with version=8 2023-02-07 14:02:41,558 INFO [Listener at localhost/40837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:41,560 INFO [Listener at localhost/40837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:41,563 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/hbase-staging 2023-02-07 14:02:41,909 INFO [Listener at localhost/40837] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-07 14:02:42,379 INFO [Listener at localhost/40837] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:02:42,411 INFO [Listener at localhost/40837] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:42,412 INFO [Listener at localhost/40837] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:42,412 INFO [Listener at localhost/40837] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:02:42,413 INFO [Listener at localhost/40837] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:42,413 INFO [Listener at localhost/40837] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:02:42,567 INFO [Listener at localhost/40837] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:02:42,641 DEBUG [Listener at localhost/40837] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-07 14:02:42,732 INFO [Listener at localhost/40837] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39545 2023-02-07 14:02:42,742 INFO [Listener at localhost/40837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:42,745 INFO [Listener at localhost/40837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:42,767 INFO [Listener at localhost/40837] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39545 connecting to ZooKeeper ensemble=127.0.0.1:55354 2023-02-07 14:02:42,821 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:395450x0, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:02:42,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39545-0x1002f177d090000 connected 2023-02-07 14:02:42,860 DEBUG [Listener at localhost/40837] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:02:42,861 DEBUG [Listener at localhost/40837] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:02:42,865 DEBUG [Listener at localhost/40837] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:02:42,874 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39545 2023-02-07 14:02:42,874 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39545 2023-02-07 14:02:42,875 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39545 2023-02-07 14:02:42,875 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39545 2023-02-07 14:02:42,875 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39545 2023-02-07 14:02:42,882 INFO [Listener at localhost/40837] master.HMaster(439): hbase.rootdir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d, hbase.cluster.distributed=false 2023-02-07 14:02:42,953 INFO [Listener at localhost/40837] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:02:42,954 INFO [Listener at localhost/40837] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:42,954 INFO [Listener at localhost/40837] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:42,954 INFO [Listener at localhost/40837] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:02:42,954 INFO [Listener at localhost/40837] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:42,954 INFO [Listener at localhost/40837] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:02:42,959 INFO [Listener at localhost/40837] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:02:42,961 INFO [Listener at localhost/40837] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35817 2023-02-07 14:02:42,964 INFO [Listener at localhost/40837] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:02:42,971 DEBUG [Listener at localhost/40837] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:42,972 INFO [Listener at localhost/40837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:42,974 INFO [Listener at localhost/40837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:42,975 INFO [Listener at localhost/40837] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35817 connecting to ZooKeeper ensemble=127.0.0.1:55354 2023-02-07 14:02:42,979 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:358170x0, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:02:42,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35817-0x1002f177d090001 connected 2023-02-07 14:02:42,980 DEBUG [Listener at localhost/40837] zookeeper.ZKUtil(164): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:02:42,981 DEBUG [Listener at localhost/40837] zookeeper.ZKUtil(164): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:02:42,982 DEBUG [Listener at localhost/40837] zookeeper.ZKUtil(164): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:02:42,984 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35817 2023-02-07 14:02:42,984 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35817 2023-02-07 14:02:42,986 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35817 2023-02-07 14:02:42,986 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35817 2023-02-07 14:02:42,987 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35817 2023-02-07 14:02:42,999 INFO [Listener at localhost/40837] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:02:42,999 INFO [Listener at localhost/40837] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:43,000 INFO [Listener at localhost/40837] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:43,000 INFO [Listener at localhost/40837] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:02:43,001 INFO [Listener at localhost/40837] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:43,001 INFO [Listener at localhost/40837] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:02:43,001 INFO [Listener at localhost/40837] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:02:43,003 INFO [Listener at localhost/40837] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42681 2023-02-07 14:02:43,004 INFO [Listener at localhost/40837] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:02:43,007 DEBUG [Listener at localhost/40837] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:43,008 INFO [Listener at localhost/40837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:43,010 INFO [Listener at localhost/40837] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:43,012 INFO [Listener at localhost/40837] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42681 connecting to ZooKeeper ensemble=127.0.0.1:55354 2023-02-07 14:02:43,017 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:426810x0, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:02:43,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42681-0x1002f177d090002 connected 2023-02-07 14:02:43,018 DEBUG [Listener at localhost/40837] zookeeper.ZKUtil(164): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:02:43,019 DEBUG [Listener at localhost/40837] zookeeper.ZKUtil(164): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:02:43,020 DEBUG [Listener at localhost/40837] zookeeper.ZKUtil(164): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:02:43,020 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42681 2023-02-07 14:02:43,024 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42681 2023-02-07 14:02:43,028 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42681 2023-02-07 14:02:43,028 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42681 2023-02-07 14:02:43,029 DEBUG [Listener at localhost/40837] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42681 2023-02-07 14:02:43,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39545,1675778561731 2023-02-07 14:02:43,047 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:02:43,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39545,1675778561731 2023-02-07 14:02:43,072 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:02:43,072 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:02:43,072 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:02:43,073 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:43,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:02:43,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39545,1675778561731 from backup master directory 2023-02-07 14:02:43,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:02:43,080 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39545,1675778561731 2023-02-07 14:02:43,081 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:02:43,081 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:02:43,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,39545,1675778561731 2023-02-07 14:02:43,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-07 14:02:43,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-07 14:02:43,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/hbase.id with ID: 89352b1d-5be4-4c42-8d6d-9ded9c4a215e 2023-02-07 14:02:43,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:43,267 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:43,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x620aabf7 to 127.0.0.1:55354 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:02:43,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39b1cee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:02:43,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:02:43,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 14:02:43,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-07 14:02:43,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-07 14:02:43,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-07 14:02:43,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-07 14:02:43,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:02:43,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/MasterData/data/master/store-tmp 2023-02-07 14:02:43,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:43,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:02:43,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:02:43,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:02:43,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:02:43,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:02:43,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:02:43,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778563522Disabling compacts and flushes for region at 1675778563522Disabling writes for close at 1675778563523 (+1 ms)Writing region close event to WAL at 1675778563523Closed at 1675778563523 2023-02-07 14:02:43,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/MasterData/WALs/jenkins-hbase4.apache.org,39545,1675778561731 2023-02-07 14:02:43,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39545%2C1675778561731, suffix=, logDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/MasterData/WALs/jenkins-hbase4.apache.org,39545,1675778561731, archiveDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/MasterData/oldWALs, maxLogs=10 2023-02-07 14:02:43,609 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33671,DS-e388ac55-a8bf-4e47-b228-d4fb292540e6,DISK] 2023-02-07 14:02:43,609 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37739,DS-28ff7299-5bb3-4a61-a833-4c1da79e189a,DISK] 2023-02-07 14:02:43,617 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-07 14:02:43,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/MasterData/WALs/jenkins-hbase4.apache.org,39545,1675778561731/jenkins-hbase4.apache.org%2C39545%2C1675778561731.1675778563560 2023-02-07 14:02:43,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37739,DS-28ff7299-5bb3-4a61-a833-4c1da79e189a,DISK], DatanodeInfoWithStorage[127.0.0.1:33671,DS-e388ac55-a8bf-4e47-b228-d4fb292540e6,DISK]] 2023-02-07 14:02:43,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:02:43,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:43,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:02:43,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:02:43,758 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:02:43,766 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 14:02:43,792 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 14:02:43,804 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:43,809 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:02:43,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:02:43,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:02:43,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:43,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73507779, jitterRate=0.09535126388072968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:02:43,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675778563727Initializing all the Stores at 1675778563729 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778563730 (+1 ms)Cleaning up temporary data from old regions at 1675778563816 (+86 ms)Cleaning up detritus from prior splits at 1675778563817 (+1 ms)Region opened successfully at 1675778563830 (+13 ms) 2023-02-07 14:02:43,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 14:02:43,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 14:02:43,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 14:02:43,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 14:02:43,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-07 14:02:43,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-02-07 14:02:43,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 14:02:43,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 14:02:43,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 14:02:43,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 14:02:43,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 14:02:43,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 14:02:43,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 14:02:43,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 14:02:43,976 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:43,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 14:02:43,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 14:02:43,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 14:02:44,000 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:02:44,000 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:02:44,000 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:02:44,001 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:44,002 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,39545,1675778561731, sessionid=0x1002f177d090000, setting cluster-up flag (Was=false) 2023-02-07 14:02:44,022 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:44,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 14:02:44,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39545,1675778561731 2023-02-07 14:02:44,038 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:44,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 14:02:44,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39545,1675778561731 2023-02-07 14:02:44,048 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.hbase-snapshot/.tmp 2023-02-07 14:02:44,135 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(952): ClusterId : 89352b1d-5be4-4c42-8d6d-9ded9c4a215e 2023-02-07 14:02:44,135 INFO [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(952): ClusterId : 89352b1d-5be4-4c42-8d6d-9ded9c4a215e 2023-02-07 14:02:44,144 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:02:44,144 DEBUG [RS:1;jenkins-hbase4:42681] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:02:44,158 DEBUG [RS:1;jenkins-hbase4:42681] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:02:44,158 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:02:44,158 DEBUG [RS:1;jenkins-hbase4:42681] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:02:44,159 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:02:44,162 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:02:44,162 DEBUG [RS:1;jenkins-hbase4:42681] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:02:44,164 DEBUG [RS:0;jenkins-hbase4:35817] zookeeper.ReadOnlyZKClient(139): Connect 0x29ed6361 to 127.0.0.1:55354 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:02:44,165 DEBUG [RS:1;jenkins-hbase4:42681] zookeeper.ReadOnlyZKClient(139): Connect 0x351fe54d to 127.0.0.1:55354 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:02:44,179 DEBUG [RS:0;jenkins-hbase4:35817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@272a982c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:02:44,179 DEBUG [RS:1;jenkins-hbase4:42681] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bd81d9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:02:44,180 DEBUG [RS:1;jenkins-hbase4:42681] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fe78e3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:02:44,180 DEBUG [RS:0;jenkins-hbase4:35817] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23150811, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:02:44,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 14:02:44,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:02:44,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:02:44,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:02:44,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:02:44,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 14:02:44,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:02:44,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675778594204 2023-02-07 14:02:44,204 DEBUG [RS:1;jenkins-hbase4:42681] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42681 2023-02-07 14:02:44,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 14:02:44,207 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35817 2023-02-07 14:02:44,211 INFO [RS:1;jenkins-hbase4:42681] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:02:44,211 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:02:44,211 INFO [RS:1;jenkins-hbase4:42681] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:02:44,211 INFO [RS:0;jenkins-hbase4:35817] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:02:44,212 INFO [RS:0;jenkins-hbase4:35817] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:02:44,212 DEBUG [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:02:44,212 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:02:44,212 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 14:02:44,215 INFO [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39545,1675778561731 with isa=jenkins-hbase4.apache.org/172.31.14.131:42681, startcode=1675778562998 2023-02-07 14:02:44,215 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39545,1675778561731 with isa=jenkins-hbase4.apache.org/172.31.14.131:35817, startcode=1675778562952 2023-02-07 14:02:44,217 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:02:44,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 14:02:44,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 14:02:44,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 14:02:44,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 14:02:44,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 14:02:44,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 14:02:44,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 14:02:44,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 14:02:44,236 DEBUG [RS:1;jenkins-hbase4:42681] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:02:44,236 DEBUG [RS:0;jenkins-hbase4:35817] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:02:44,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 14:02:44,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 14:02:44,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778564240,5,FailOnTimeoutGroup] 2023-02-07 14:02:44,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778564240,5,FailOnTimeoutGroup] 2023-02-07 14:02:44,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 14:02:44,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,263 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:02:44,264 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:02:44,264 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d 2023-02-07 14:02:44,296 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:44,299 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:02:44,302 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/info 2023-02-07 14:02:44,303 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:02:44,304 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:44,305 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:02:44,305 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39971, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:02:44,305 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59325, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:02:44,307 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:02:44,308 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:02:44,309 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:44,309 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:02:44,311 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/table 2023-02-07 14:02:44,312 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:02:44,313 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:44,315 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740 2023-02-07 14:02:44,316 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740 2023-02-07 14:02:44,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:44,319 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39545] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:44,321 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:02:44,324 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:02:44,328 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:44,329 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67096374, jitterRate=-1.8611550331115723E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:02:44,330 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675778564297Initializing all the Stores at 1675778564298 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778564299 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778564299Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778564299Cleaning up temporary data from old regions at 1675778564319 (+20 ms)Cleaning up detritus from prior splits at 1675778564320 (+1 ms)Region opened successfully at 1675778564330 (+10 ms) 2023-02-07 14:02:44,330 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:02:44,330 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:02:44,330 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:02:44,330 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:02:44,330 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:02:44,331 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:02:44,331 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778564330Disabling compacts and flushes for region at 1675778564330Disabling writes for close at 1675778564330Writing region close event to WAL at 1675778564331 (+1 ms)Closed at 1675778564331 2023-02-07 14:02:44,337 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:02:44,337 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 14:02:44,339 DEBUG [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d 2023-02-07 14:02:44,339 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d 2023-02-07 14:02:44,340 DEBUG [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37673 2023-02-07 14:02:44,340 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:37673 2023-02-07 14:02:44,340 DEBUG [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:02:44,340 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:02:44,345 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:02:44,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 14:02:44,351 DEBUG [RS:0;jenkins-hbase4:35817] zookeeper.ZKUtil(162): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:44,351 WARN [RS:0;jenkins-hbase4:35817] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:02:44,351 INFO [RS:0;jenkins-hbase4:35817] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:02:44,351 DEBUG [RS:1;jenkins-hbase4:42681] zookeeper.ZKUtil(162): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:44,351 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35817,1675778562952] 2023-02-07 14:02:44,351 WARN [RS:1;jenkins-hbase4:42681] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:02:44,351 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/WALs/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:44,352 INFO [RS:1;jenkins-hbase4:42681] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:02:44,352 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42681,1675778562998] 2023-02-07 14:02:44,352 DEBUG [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(1947): logDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/WALs/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:44,363 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 14:02:44,365 DEBUG [RS:1;jenkins-hbase4:42681] zookeeper.ZKUtil(162): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:44,365 DEBUG [RS:0;jenkins-hbase4:35817] zookeeper.ZKUtil(162): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:44,366 DEBUG [RS:1;jenkins-hbase4:42681] zookeeper.ZKUtil(162): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:44,366 DEBUG [RS:0;jenkins-hbase4:35817] zookeeper.ZKUtil(162): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:44,366 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 14:02:44,378 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:02:44,378 DEBUG [RS:1;jenkins-hbase4:42681] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:02:44,388 INFO [RS:1;jenkins-hbase4:42681] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:02:44,388 INFO [RS:0;jenkins-hbase4:35817] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:02:44,409 INFO [RS:0;jenkins-hbase4:35817] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:02:44,409 INFO [RS:1;jenkins-hbase4:42681] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:02:44,414 INFO [RS:0;jenkins-hbase4:35817] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:02:44,414 INFO [RS:1;jenkins-hbase4:42681] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:02:44,414 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,414 INFO [RS:1;jenkins-hbase4:42681] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,415 INFO [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:02:44,415 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:02:44,424 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,424 INFO [RS:1;jenkins-hbase4:42681] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,424 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,424 DEBUG [RS:1;jenkins-hbase4:42681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,424 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,424 DEBUG [RS:1;jenkins-hbase4:42681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,424 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,425 DEBUG [RS:1;jenkins-hbase4:42681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,425 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,425 DEBUG [RS:1;jenkins-hbase4:42681] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,425 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,425 DEBUG [RS:1;jenkins-hbase4:42681] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,425 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:02:44,425 DEBUG [RS:1;jenkins-hbase4:42681] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:02:44,425 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,425 DEBUG [RS:1;jenkins-hbase4:42681] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,425 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,425 DEBUG [RS:1;jenkins-hbase4:42681] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,426 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,426 DEBUG [RS:1;jenkins-hbase4:42681] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,426 DEBUG [RS:0;jenkins-hbase4:35817] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,426 DEBUG [RS:1;jenkins-hbase4:42681] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:44,427 INFO [RS:1;jenkins-hbase4:42681] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,427 INFO [RS:1;jenkins-hbase4:42681] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,427 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,427 INFO [RS:1;jenkins-hbase4:42681] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,427 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,427 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,442 INFO [RS:1;jenkins-hbase4:42681] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:02:44,442 INFO [RS:0;jenkins-hbase4:35817] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:02:44,445 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35817,1675778562952-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,445 INFO [RS:1;jenkins-hbase4:42681] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42681,1675778562998-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:44,468 INFO [RS:1;jenkins-hbase4:42681] regionserver.Replication(203): jenkins-hbase4.apache.org,42681,1675778562998 started 2023-02-07 14:02:44,468 INFO [RS:0;jenkins-hbase4:35817] regionserver.Replication(203): jenkins-hbase4.apache.org,35817,1675778562952 started 2023-02-07 14:02:44,468 INFO [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42681,1675778562998, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42681, sessionid=0x1002f177d090002 2023-02-07 14:02:44,468 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35817,1675778562952, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35817, sessionid=0x1002f177d090001 2023-02-07 14:02:44,468 DEBUG [RS:1;jenkins-hbase4:42681] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:02:44,468 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:02:44,468 DEBUG [RS:1;jenkins-hbase4:42681] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:44,469 DEBUG [RS:0;jenkins-hbase4:35817] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:44,469 DEBUG [RS:1;jenkins-hbase4:42681] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42681,1675778562998' 2023-02-07 14:02:44,469 DEBUG [RS:0;jenkins-hbase4:35817] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35817,1675778562952' 2023-02-07 14:02:44,470 DEBUG [RS:0;jenkins-hbase4:35817] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:02:44,470 DEBUG [RS:1;jenkins-hbase4:42681] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:02:44,471 DEBUG [RS:1;jenkins-hbase4:42681] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:02:44,471 DEBUG [RS:0;jenkins-hbase4:35817] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:02:44,471 DEBUG [RS:1;jenkins-hbase4:42681] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:02:44,471 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:02:44,471 DEBUG [RS:1;jenkins-hbase4:42681] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:02:44,471 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:02:44,472 DEBUG [RS:1;jenkins-hbase4:42681] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:44,472 DEBUG [RS:0;jenkins-hbase4:35817] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:44,472 DEBUG [RS:0;jenkins-hbase4:35817] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35817,1675778562952' 2023-02-07 14:02:44,472 DEBUG [RS:0;jenkins-hbase4:35817] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:02:44,472 DEBUG [RS:1;jenkins-hbase4:42681] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42681,1675778562998' 2023-02-07 14:02:44,472 DEBUG [RS:1;jenkins-hbase4:42681] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:02:44,473 DEBUG [RS:0;jenkins-hbase4:35817] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:02:44,473 DEBUG [RS:1;jenkins-hbase4:42681] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:02:44,473 DEBUG [RS:0;jenkins-hbase4:35817] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:02:44,474 INFO [RS:0;jenkins-hbase4:35817] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:02:44,474 DEBUG [RS:1;jenkins-hbase4:42681] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:02:44,474 INFO [RS:0;jenkins-hbase4:35817] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:02:44,474 INFO [RS:1;jenkins-hbase4:42681] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:02:44,474 INFO [RS:1;jenkins-hbase4:42681] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:02:44,518 DEBUG [jenkins-hbase4:39545] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 14:02:44,523 DEBUG [jenkins-hbase4:39545] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:02:44,530 DEBUG [jenkins-hbase4:39545] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:02:44,530 DEBUG [jenkins-hbase4:39545] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:02:44,531 DEBUG [jenkins-hbase4:39545] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:02:44,533 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35817,1675778562952, state=OPENING 2023-02-07 14:02:44,540 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 14:02:44,542 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:44,543 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:02:44,546 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35817,1675778562952}] 2023-02-07 14:02:44,732 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:44,734 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 14:02:44,738 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49224, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 14:02:44,750 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 14:02:44,750 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:02:44,753 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35817%2C1675778562952.meta, suffix=.meta, logDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/WALs/jenkins-hbase4.apache.org,35817,1675778562952, archiveDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/oldWALs, maxLogs=32 2023-02-07 14:02:44,776 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33671,DS-e388ac55-a8bf-4e47-b228-d4fb292540e6,DISK] 2023-02-07 14:02:44,776 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37739,DS-28ff7299-5bb3-4a61-a833-4c1da79e189a,DISK] 2023-02-07 14:02:44,781 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/WALs/jenkins-hbase4.apache.org,35817,1675778562952/jenkins-hbase4.apache.org%2C35817%2C1675778562952.meta.1675778564756.meta 2023-02-07 14:02:44,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33671,DS-e388ac55-a8bf-4e47-b228-d4fb292540e6,DISK], DatanodeInfoWithStorage[127.0.0.1:37739,DS-28ff7299-5bb3-4a61-a833-4c1da79e189a,DISK]] 2023-02-07 14:02:44,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:02:44,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 14:02:44,799 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 14:02:44,805 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 14:02:44,810 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 14:02:44,810 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:44,810 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 14:02:44,810 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 14:02:44,813 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:02:44,814 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/info 2023-02-07 14:02:44,815 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/info 2023-02-07 14:02:44,815 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:02:44,816 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:44,816 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:02:44,818 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:02:44,818 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:02:44,819 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:02:44,819 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:44,819 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:02:44,821 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/table 2023-02-07 14:02:44,821 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/table 2023-02-07 14:02:44,822 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:02:44,822 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:44,824 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740 2023-02-07 14:02:44,827 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740 2023-02-07 14:02:44,832 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:02:44,835 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:02:44,837 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69932988, jitterRate=0.04208272695541382}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:02:44,837 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675778564810Writing region info on filesystem at 1675778564811 (+1 ms)Initializing all the Stores at 1675778564812 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778564812Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778564813 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778564813Cleaning up temporary data from old regions at 1675778564829 (+16 ms)Cleaning up detritus from prior splits at 1675778564830 (+1 ms)Running coprocessor post-open hooks at 1675778564837 (+7 ms)Region opened successfully at 1675778564837 2023-02-07 14:02:44,850 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675778564724 2023-02-07 14:02:44,869 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 14:02:44,870 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 14:02:44,870 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35817,1675778562952, state=OPEN 2023-02-07 14:02:44,875 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 14:02:44,875 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:02:44,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 14:02:44,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35817,1675778562952 in 329 msec 2023-02-07 14:02:44,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 14:02:44,886 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 535 msec 2023-02-07 14:02:44,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 782 msec 2023-02-07 14:02:44,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675778563069, completionTime=-1 2023-02-07 14:02:44,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 14:02:44,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 14:02:44,959 DEBUG [hconnection-0x675b266b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:02:44,962 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49236, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:02:44,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 14:02:44,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675778624978 2023-02-07 14:02:44,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675778684978 2023-02-07 14:02:44,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 86 msec 2023-02-07 14:02:45,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39545,1675778561731-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:45,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39545,1675778561731-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:45,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39545,1675778561731-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:45,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39545, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:45,003 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:45,009 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 14:02:45,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 14:02:45,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:02:45,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 14:02:45,031 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:02:45,034 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:02:45,055 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/hbase/namespace/66d97a88fe08e7a64e965d45f6523e50 2023-02-07 14:02:45,058 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/hbase/namespace/66d97a88fe08e7a64e965d45f6523e50 empty. 2023-02-07 14:02:45,059 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/hbase/namespace/66d97a88fe08e7a64e965d45f6523e50 2023-02-07 14:02:45,059 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 14:02:45,084 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 14:02:45,086 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 66d97a88fe08e7a64e965d45f6523e50, NAME => 'hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp 2023-02-07 14:02:45,105 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:45,105 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 66d97a88fe08e7a64e965d45f6523e50, disabling compactions & flushes 2023-02-07 14:02:45,105 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. 2023-02-07 14:02:45,105 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. 2023-02-07 14:02:45,105 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. after waiting 0 ms 2023-02-07 14:02:45,105 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. 2023-02-07 14:02:45,105 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. 2023-02-07 14:02:45,105 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 66d97a88fe08e7a64e965d45f6523e50: Waiting for close lock at 1675778565105Disabling compacts and flushes for region at 1675778565105Disabling writes for close at 1675778565105Writing region close event to WAL at 1675778565105Closed at 1675778565105 2023-02-07 14:02:45,110 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:02:45,127 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778565114"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778565114"}]},"ts":"1675778565114"} 2023-02-07 14:02:45,154 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 14:02:45,156 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:02:45,160 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778565156"}]},"ts":"1675778565156"} 2023-02-07 14:02:45,164 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 14:02:45,169 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:02:45,171 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:02:45,171 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:02:45,171 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:02:45,173 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=66d97a88fe08e7a64e965d45f6523e50, ASSIGN}] 2023-02-07 14:02:45,176 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=66d97a88fe08e7a64e965d45f6523e50, ASSIGN 2023-02-07 14:02:45,178 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=66d97a88fe08e7a64e965d45f6523e50, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42681,1675778562998; forceNewPlan=false, retain=false 2023-02-07 14:02:45,332 INFO [jenkins-hbase4:39545] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 14:02:45,333 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=66d97a88fe08e7a64e965d45f6523e50, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:45,333 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778565333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778565333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778565333"}]},"ts":"1675778565333"} 2023-02-07 14:02:45,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 66d97a88fe08e7a64e965d45f6523e50, server=jenkins-hbase4.apache.org,42681,1675778562998}] 2023-02-07 14:02:45,485 INFO [RS:1;jenkins-hbase4:42681] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42681%2C1675778562998, suffix=, logDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/WALs/jenkins-hbase4.apache.org,42681,1675778562998, archiveDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/oldWALs, maxLogs=32 2023-02-07 14:02:45,485 INFO [RS:0;jenkins-hbase4:35817] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35817%2C1675778562952, suffix=, logDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/WALs/jenkins-hbase4.apache.org,35817,1675778562952, archiveDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/oldWALs, maxLogs=32 2023-02-07 14:02:45,492 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:45,492 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 14:02:45,495 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42806, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 14:02:45,508 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. 2023-02-07 14:02:45,515 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33671,DS-e388ac55-a8bf-4e47-b228-d4fb292540e6,DISK] 2023-02-07 14:02:45,515 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37739,DS-28ff7299-5bb3-4a61-a833-4c1da79e189a,DISK] 2023-02-07 14:02:45,515 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33671,DS-e388ac55-a8bf-4e47-b228-d4fb292540e6,DISK] 2023-02-07 14:02:45,516 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37739,DS-28ff7299-5bb3-4a61-a833-4c1da79e189a,DISK] 2023-02-07 14:02:45,521 INFO [RS:0;jenkins-hbase4:35817] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/WALs/jenkins-hbase4.apache.org,35817,1675778562952/jenkins-hbase4.apache.org%2C35817%2C1675778562952.1675778565486 2023-02-07 14:02:45,521 INFO [RS:1;jenkins-hbase4:42681] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/WALs/jenkins-hbase4.apache.org,42681,1675778562998/jenkins-hbase4.apache.org%2C42681%2C1675778562998.1675778565487 2023-02-07 14:02:45,522 DEBUG [RS:0;jenkins-hbase4:35817] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33671,DS-e388ac55-a8bf-4e47-b228-d4fb292540e6,DISK], DatanodeInfoWithStorage[127.0.0.1:37739,DS-28ff7299-5bb3-4a61-a833-4c1da79e189a,DISK]] 2023-02-07 14:02:45,522 DEBUG [RS:1;jenkins-hbase4:42681] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33671,DS-e388ac55-a8bf-4e47-b228-d4fb292540e6,DISK], DatanodeInfoWithStorage[127.0.0.1:37739,DS-28ff7299-5bb3-4a61-a833-4c1da79e189a,DISK]] 2023-02-07 14:02:45,522 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 66d97a88fe08e7a64e965d45f6523e50, NAME => 'hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:02:45,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 66d97a88fe08e7a64e965d45f6523e50 2023-02-07 14:02:45,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:45,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 66d97a88fe08e7a64e965d45f6523e50 2023-02-07 14:02:45,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 66d97a88fe08e7a64e965d45f6523e50 2023-02-07 14:02:45,528 INFO [StoreOpener-66d97a88fe08e7a64e965d45f6523e50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 66d97a88fe08e7a64e965d45f6523e50 2023-02-07 14:02:45,531 DEBUG [StoreOpener-66d97a88fe08e7a64e965d45f6523e50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/namespace/66d97a88fe08e7a64e965d45f6523e50/info 2023-02-07 14:02:45,531 DEBUG [StoreOpener-66d97a88fe08e7a64e965d45f6523e50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/namespace/66d97a88fe08e7a64e965d45f6523e50/info 2023-02-07 14:02:45,532 INFO [StoreOpener-66d97a88fe08e7a64e965d45f6523e50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66d97a88fe08e7a64e965d45f6523e50 columnFamilyName info 2023-02-07 14:02:45,533 INFO [StoreOpener-66d97a88fe08e7a64e965d45f6523e50-1] regionserver.HStore(310): Store=66d97a88fe08e7a64e965d45f6523e50/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:45,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/namespace/66d97a88fe08e7a64e965d45f6523e50 2023-02-07 14:02:45,536 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/namespace/66d97a88fe08e7a64e965d45f6523e50 2023-02-07 14:02:45,542 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 66d97a88fe08e7a64e965d45f6523e50 2023-02-07 14:02:45,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/namespace/66d97a88fe08e7a64e965d45f6523e50/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:45,548 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 66d97a88fe08e7a64e965d45f6523e50; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62709637, jitterRate=-0.06555359065532684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:02:45,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 66d97a88fe08e7a64e965d45f6523e50: Running coprocessor pre-open hook at 1675778565523Writing region info on filesystem at 1675778565523Initializing all the Stores at 1675778565525 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778565525Cleaning up temporary data from old regions at 1675778565537 (+12 ms)Cleaning up detritus from prior splits at 1675778565538 (+1 ms)Running coprocessor post-open hooks at 1675778565548 (+10 ms)Region opened successfully at 1675778565548 2023-02-07 14:02:45,552 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50., pid=6, masterSystemTime=1675778565492 2023-02-07 14:02:45,557 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. 2023-02-07 14:02:45,558 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. 2023-02-07 14:02:45,559 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=66d97a88fe08e7a64e965d45f6523e50, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:45,560 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778565558"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778565558"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778565558"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778565558"}]},"ts":"1675778565558"} 2023-02-07 14:02:45,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 14:02:45,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 66d97a88fe08e7a64e965d45f6523e50, server=jenkins-hbase4.apache.org,42681,1675778562998 in 226 msec 2023-02-07 14:02:45,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 14:02:45,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=66d97a88fe08e7a64e965d45f6523e50, ASSIGN in 395 msec 2023-02-07 14:02:45,573 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:02:45,574 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778565574"}]},"ts":"1675778565574"} 2023-02-07 14:02:45,578 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 14:02:45,581 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:02:45,584 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 561 msec 2023-02-07 14:02:45,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 14:02:45,633 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:02:45,633 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:45,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:02:45,657 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42812, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:02:45,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 14:02:45,687 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:02:45,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-02-07 14:02:45,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 14:02:45,715 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:02:45,720 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-02-07 14:02:45,730 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 14:02:45,732 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 14:02:45,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.651sec 2023-02-07 14:02:45,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 14:02:45,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 14:02:45,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 14:02:45,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39545,1675778561731-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 14:02:45,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39545,1675778561731-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 14:02:45,744 DEBUG [Listener at localhost/40837] zookeeper.ReadOnlyZKClient(139): Connect 0x54183f42 to 127.0.0.1:55354 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:02:45,748 DEBUG [Listener at localhost/40837] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45c9f035, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:02:45,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 14:02:45,782 DEBUG [hconnection-0x2c01b7e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:02:45,793 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49242, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:02:45,805 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39545,1675778561731 2023-02-07 14:02:45,806 DEBUG [Listener at localhost/40837] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 14:02:45,808 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:45,808 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:45,818 DEBUG [Listener at localhost/40837] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 14:02:45,821 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39826, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 14:02:45,826 INFO [Listener at localhost/40837] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 14:02:45,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-07 14:02:45,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 14:02:45,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:39826 deadline: 1675778625831, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-07 14:02:45,850 INFO [Listener at localhost/40837] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-07 14:02:45,852 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:45,852 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:45,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:02:45,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-07 14:02:45,867 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:02:45,869 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:02:45,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-07 14:02:45,880 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:45,880 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:45,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:02:45,892 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:45,892 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:45,893 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:45,893 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:45,893 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:45,893 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:45,894 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:45,894 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3 2023-02-07 14:02:45,894 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c empty. 2023-02-07 14:02:45,894 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf empty. 2023-02-07 14:02:45,894 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f empty. 2023-02-07 14:02:45,894 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a empty. 2023-02-07 14:02:45,896 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427 empty. 2023-02-07 14:02:45,896 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:45,896 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:45,896 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:45,896 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:45,896 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a empty. 2023-02-07 14:02:45,896 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:45,896 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:45,896 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3 empty. 2023-02-07 14:02:45,896 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:45,896 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525 empty. 2023-02-07 14:02:45,897 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3 empty. 2023-02-07 14:02:45,897 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:45,897 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3 empty. 2023-02-07 14:02:45,898 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:45,898 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3 2023-02-07 14:02:45,898 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:45,898 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:45,898 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 14:02:45,917 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-07 14:02:45,919 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3e8eb2655570dcc33e6f1d2553004acf, NAME => 'testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp 2023-02-07 14:02:45,919 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => e9a23cbdeed13f0100ce5ce7445e651a, NAME => 'testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp 2023-02-07 14:02:45,919 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4e403e3da79dd6bdefdf65e3b57bcd6f, NAME => 'testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp 2023-02-07 14:02:45,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:45,963 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:45,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3e8eb2655570dcc33e6f1d2553004acf, disabling compactions & flushes 2023-02-07 14:02:45,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing e9a23cbdeed13f0100ce5ce7445e651a, disabling compactions & flushes 2023-02-07 14:02:45,964 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:45,964 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:45,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:45,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:45,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. after waiting 0 ms 2023-02-07 14:02:45,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 4e403e3da79dd6bdefdf65e3b57bcd6f, disabling compactions & flushes 2023-02-07 14:02:45,964 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:45,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:45,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:45,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:45,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. after waiting 0 ms 2023-02-07 14:02:45,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. after waiting 0 ms 2023-02-07 14:02:45,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:45,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:45,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3e8eb2655570dcc33e6f1d2553004acf: Waiting for close lock at 1675778565964Disabling compacts and flushes for region at 1675778565964Disabling writes for close at 1675778565965 (+1 ms)Writing region close event to WAL at 1675778565965Closed at 1675778565965 2023-02-07 14:02:45,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:45,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:45,965 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:45,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 4e403e3da79dd6bdefdf65e3b57bcd6f: Waiting for close lock at 1675778565965Disabling compacts and flushes for region at 1675778565965Disabling writes for close at 1675778565965Writing region close event to WAL at 1675778565965Closed at 1675778565965 2023-02-07 14:02:45,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for e9a23cbdeed13f0100ce5ce7445e651a: Waiting for close lock at 1675778565964Disabling compacts and flushes for region at 1675778565964Disabling writes for close at 1675778565965 (+1 ms)Writing region close event to WAL at 1675778565965Closed at 1675778565965 2023-02-07 14:02:45,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 74a6ba96b740e3fd09a268bcd8453427, NAME => 'testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp 2023-02-07 14:02:45,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 45af8e26bbb35d3c7fbeb12766ba1e5c, NAME => 'testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp 2023-02-07 14:02:45,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e1cdf44635ff1b97044d6263fbaa981a, NAME => 'testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp 2023-02-07 14:02:45,991 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:46,002 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:46,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:02:46,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 45af8e26bbb35d3c7fbeb12766ba1e5c, disabling compactions & flushes 2023-02-07 14:02:46,015 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:46,016 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:46,016 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. after waiting 0 ms 2023-02-07 14:02:46,016 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:46,016 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:46,016 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 45af8e26bbb35d3c7fbeb12766ba1e5c: Waiting for close lock at 1675778566015Disabling compacts and flushes for region at 1675778566015Disabling writes for close at 1675778566016 (+1 ms)Writing region close event to WAL at 1675778566016Closed at 1675778566016 2023-02-07 14:02:46,016 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8691d855b35ad124573f3d9aa7a6c525, NAME => 'testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp 2023-02-07 14:02:46,020 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e1cdf44635ff1b97044d6263fbaa981a, disabling compactions & flushes 2023-02-07 14:02:46,021 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:46,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:46,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. after waiting 0 ms 2023-02-07 14:02:46,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:46,021 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:46,021 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e1cdf44635ff1b97044d6263fbaa981a: Waiting for close lock at 1675778566021Disabling compacts and flushes for region at 1675778566021Disabling writes for close at 1675778566021Writing region close event to WAL at 1675778566021Closed at 1675778566021 2023-02-07 14:02:46,022 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b3da998557027663b1b762e486d589c3, NAME => 'testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp 2023-02-07 14:02:46,022 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,023 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 74a6ba96b740e3fd09a268bcd8453427, disabling compactions & flushes 2023-02-07 14:02:46,023 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:46,023 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:46,023 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. after waiting 0 ms 2023-02-07 14:02:46,023 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:46,023 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:46,024 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 74a6ba96b740e3fd09a268bcd8453427: Waiting for close lock at 1675778566023Disabling compacts and flushes for region at 1675778566023Disabling writes for close at 1675778566023Writing region close event to WAL at 1675778566023Closed at 1675778566023 2023-02-07 14:02:46,024 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 6816d8c175af9806ef749579bd93cbf3, NAME => 'testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp 2023-02-07 14:02:46,041 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,045 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 8691d855b35ad124573f3d9aa7a6c525, disabling compactions & flushes 2023-02-07 14:02:46,046 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:46,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:46,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. after waiting 0 ms 2023-02-07 14:02:46,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:46,046 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:46,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 8691d855b35ad124573f3d9aa7a6c525: Waiting for close lock at 1675778566045Disabling compacts and flushes for region at 1675778566045Disabling writes for close at 1675778566046 (+1 ms)Writing region close event to WAL at 1675778566046Closed at 1675778566046 2023-02-07 14:02:46,047 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 02dbd90de942d8345117748d1abdcdd3, NAME => 'testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp 2023-02-07 14:02:46,054 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,055 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b3da998557027663b1b762e486d589c3, disabling compactions & flushes 2023-02-07 14:02:46,059 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:46,059 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:46,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. after waiting 0 ms 2023-02-07 14:02:46,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:46,060 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:46,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b3da998557027663b1b762e486d589c3: Waiting for close lock at 1675778566055Disabling compacts and flushes for region at 1675778566055Disabling writes for close at 1675778566060 (+5 ms)Writing region close event to WAL at 1675778566060Closed at 1675778566060 2023-02-07 14:02:46,084 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,084 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 6816d8c175af9806ef749579bd93cbf3, disabling compactions & flushes 2023-02-07 14:02:46,084 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:46,084 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:46,084 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. after waiting 0 ms 2023-02-07 14:02:46,085 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:46,085 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:46,085 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 6816d8c175af9806ef749579bd93cbf3: Waiting for close lock at 1675778566084Disabling compacts and flushes for region at 1675778566084Disabling writes for close at 1675778566085 (+1 ms)Writing region close event to WAL at 1675778566085Closed at 1675778566085 2023-02-07 14:02:46,086 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,086 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 02dbd90de942d8345117748d1abdcdd3, disabling compactions & flushes 2023-02-07 14:02:46,086 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:46,086 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:46,086 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. after waiting 0 ms 2023-02-07 14:02:46,086 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:46,086 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:46,086 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 02dbd90de942d8345117748d1abdcdd3: Waiting for close lock at 1675778566086Disabling compacts and flushes for region at 1675778566086Disabling writes for close at 1675778566086Writing region close event to WAL at 1675778566086Closed at 1675778566086 2023-02-07 14:02:46,091 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:02:46,093 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778566093"}]},"ts":"1675778566093"} 2023-02-07 14:02:46,093 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778566093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778566093"}]},"ts":"1675778566093"} 2023-02-07 14:02:46,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778566093"}]},"ts":"1675778566093"} 2023-02-07 14:02:46,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778566093"}]},"ts":"1675778566093"} 2023-02-07 14:02:46,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778566093"}]},"ts":"1675778566093"} 2023-02-07 14:02:46,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778566093"}]},"ts":"1675778566093"} 2023-02-07 14:02:46,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778566093"}]},"ts":"1675778566093"} 2023-02-07 14:02:46,095 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778566093"}]},"ts":"1675778566093"} 2023-02-07 14:02:46,095 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778566093"}]},"ts":"1675778566093"} 2023-02-07 14:02:46,095 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778566093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778566093"}]},"ts":"1675778566093"} 2023-02-07 14:02:46,145 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-07 14:02:46,147 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:02:46,147 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778566147"}]},"ts":"1675778566147"} 2023-02-07 14:02:46,150 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-07 14:02:46,155 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:02:46,176 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:02:46,177 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:02:46,177 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:02:46,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4e403e3da79dd6bdefdf65e3b57bcd6f, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e9a23cbdeed13f0100ce5ce7445e651a, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3e8eb2655570dcc33e6f1d2553004acf, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=45af8e26bbb35d3c7fbeb12766ba1e5c, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e1cdf44635ff1b97044d6263fbaa981a, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=74a6ba96b740e3fd09a268bcd8453427, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8691d855b35ad124573f3d9aa7a6c525, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b3da998557027663b1b762e486d589c3, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6816d8c175af9806ef749579bd93cbf3, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=02dbd90de942d8345117748d1abdcdd3, ASSIGN}] 2023-02-07 14:02:46,183 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4e403e3da79dd6bdefdf65e3b57bcd6f, ASSIGN 2023-02-07 14:02:46,183 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3e8eb2655570dcc33e6f1d2553004acf, ASSIGN 2023-02-07 14:02:46,183 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e9a23cbdeed13f0100ce5ce7445e651a, ASSIGN 2023-02-07 14:02:46,184 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=45af8e26bbb35d3c7fbeb12766ba1e5c, ASSIGN 2023-02-07 14:02:46,185 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4e403e3da79dd6bdefdf65e3b57bcd6f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42681,1675778562998; forceNewPlan=false, retain=false 2023-02-07 14:02:46,186 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e9a23cbdeed13f0100ce5ce7445e651a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35817,1675778562952; forceNewPlan=false, retain=false 2023-02-07 14:02:46,186 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=45af8e26bbb35d3c7fbeb12766ba1e5c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42681,1675778562998; forceNewPlan=false, retain=false 2023-02-07 14:02:46,186 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3e8eb2655570dcc33e6f1d2553004acf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35817,1675778562952; forceNewPlan=false, retain=false 2023-02-07 14:02:46,187 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=02dbd90de942d8345117748d1abdcdd3, ASSIGN 2023-02-07 14:02:46,198 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=6816d8c175af9806ef749579bd93cbf3, ASSIGN 2023-02-07 14:02:46,198 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=02dbd90de942d8345117748d1abdcdd3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42681,1675778562998; forceNewPlan=false, retain=false 2023-02-07 14:02:46,199 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b3da998557027663b1b762e486d589c3, ASSIGN 2023-02-07 14:02:46,200 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=6816d8c175af9806ef749579bd93cbf3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35817,1675778562952; forceNewPlan=false, retain=false 2023-02-07 14:02:46,201 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8691d855b35ad124573f3d9aa7a6c525, ASSIGN 2023-02-07 14:02:46,201 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=74a6ba96b740e3fd09a268bcd8453427, ASSIGN 2023-02-07 14:02:46,201 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b3da998557027663b1b762e486d589c3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42681,1675778562998; forceNewPlan=false, retain=false 2023-02-07 14:02:46,202 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e1cdf44635ff1b97044d6263fbaa981a, ASSIGN 2023-02-07 14:02:46,203 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8691d855b35ad124573f3d9aa7a6c525, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35817,1675778562952; forceNewPlan=false, retain=false 2023-02-07 14:02:46,204 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=74a6ba96b740e3fd09a268bcd8453427, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42681,1675778562998; forceNewPlan=false, retain=false 2023-02-07 14:02:46,204 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e1cdf44635ff1b97044d6263fbaa981a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35817,1675778562952; forceNewPlan=false, retain=false 2023-02-07 14:02:46,212 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:46,212 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:46,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:02:46,336 INFO [jenkins-hbase4:39545] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-07 14:02:46,341 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=b3da998557027663b1b762e486d589c3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:46,341 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=45af8e26bbb35d3c7fbeb12766ba1e5c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:46,341 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566341"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778566341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778566341"}]},"ts":"1675778566341"} 2023-02-07 14:02:46,341 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566341"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778566341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778566341"}]},"ts":"1675778566341"} 2023-02-07 14:02:46,341 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4e403e3da79dd6bdefdf65e3b57bcd6f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:46,341 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=74a6ba96b740e3fd09a268bcd8453427, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:46,342 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778566341"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778566341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778566341"}]},"ts":"1675778566341"} 2023-02-07 14:02:46,342 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566341"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778566341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778566341"}]},"ts":"1675778566341"} 2023-02-07 14:02:46,341 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=02dbd90de942d8345117748d1abdcdd3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:46,343 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778566341"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778566341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778566341"}]},"ts":"1675778566341"} 2023-02-07 14:02:46,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=18, state=RUNNABLE; OpenRegionProcedure b3da998557027663b1b762e486d589c3, server=jenkins-hbase4.apache.org,42681,1675778562998}] 2023-02-07 14:02:46,348 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=14, state=RUNNABLE; OpenRegionProcedure 45af8e26bbb35d3c7fbeb12766ba1e5c, server=jenkins-hbase4.apache.org,42681,1675778562998}] 2023-02-07 14:02:46,351 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure 4e403e3da79dd6bdefdf65e3b57bcd6f, server=jenkins-hbase4.apache.org,42681,1675778562998}] 2023-02-07 14:02:46,352 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=8691d855b35ad124573f3d9aa7a6c525, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:46,353 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566352"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778566352"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778566352"}]},"ts":"1675778566352"} 2023-02-07 14:02:46,354 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 74a6ba96b740e3fd09a268bcd8453427, server=jenkins-hbase4.apache.org,42681,1675778562998}] 2023-02-07 14:02:46,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure 02dbd90de942d8345117748d1abdcdd3, server=jenkins-hbase4.apache.org,42681,1675778562998}] 2023-02-07 14:02:46,358 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e9a23cbdeed13f0100ce5ce7445e651a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:46,358 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566358"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778566358"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778566358"}]},"ts":"1675778566358"} 2023-02-07 14:02:46,359 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3e8eb2655570dcc33e6f1d2553004acf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:46,359 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778566359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778566359"}]},"ts":"1675778566359"} 2023-02-07 14:02:46,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure 8691d855b35ad124573f3d9aa7a6c525, server=jenkins-hbase4.apache.org,35817,1675778562952}] 2023-02-07 14:02:46,364 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=6816d8c175af9806ef749579bd93cbf3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:46,364 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566364"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778566364"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778566364"}]},"ts":"1675778566364"} 2023-02-07 14:02:46,364 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=12, state=RUNNABLE; OpenRegionProcedure e9a23cbdeed13f0100ce5ce7445e651a, server=jenkins-hbase4.apache.org,35817,1675778562952}] 2023-02-07 14:02:46,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=13, state=RUNNABLE; OpenRegionProcedure 3e8eb2655570dcc33e6f1d2553004acf, server=jenkins-hbase4.apache.org,35817,1675778562952}] 2023-02-07 14:02:46,372 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e1cdf44635ff1b97044d6263fbaa981a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:46,372 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778566372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778566372"}]},"ts":"1675778566372"} 2023-02-07 14:02:46,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=19, state=RUNNABLE; OpenRegionProcedure 6816d8c175af9806ef749579bd93cbf3, server=jenkins-hbase4.apache.org,35817,1675778562952}] 2023-02-07 14:02:46,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure e1cdf44635ff1b97044d6263fbaa981a, server=jenkins-hbase4.apache.org,35817,1675778562952}] 2023-02-07 14:02:46,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:46,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 74a6ba96b740e3fd09a268bcd8453427, NAME => 'testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-07 14:02:46,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:46,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:46,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:46,509 INFO [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:46,511 DEBUG [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1 2023-02-07 14:02:46,511 DEBUG [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1 2023-02-07 14:02:46,511 INFO [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74a6ba96b740e3fd09a268bcd8453427 columnFamilyName f1 2023-02-07 14:02:46,512 INFO [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] regionserver.HStore(310): Store=74a6ba96b740e3fd09a268bcd8453427/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,512 INFO [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:46,515 DEBUG [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2 2023-02-07 14:02:46,515 DEBUG [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2 2023-02-07 14:02:46,515 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:46,516 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:46,516 INFO [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74a6ba96b740e3fd09a268bcd8453427 columnFamilyName f2 2023-02-07 14:02:46,517 INFO [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] regionserver.HStore(310): Store=74a6ba96b740e3fd09a268bcd8453427/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:02:46,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:46,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:46,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:46,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:46,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:46,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:46,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 74a6ba96b740e3fd09a268bcd8453427; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66917266, jitterRate=-0.0028550326824188232}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:46,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6816d8c175af9806ef749579bd93cbf3, NAME => 'testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-07 14:02:46,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 74a6ba96b740e3fd09a268bcd8453427: Running coprocessor pre-open hook at 1675778566507Writing region info on filesystem at 1675778566507Initializing all the Stores at 1675778566508 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566508Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566509 (+1 ms)Cleaning up temporary data from old regions at 1675778566521 (+12 ms)Cleaning up detritus from prior splits at 1675778566522 (+1 ms)Running coprocessor post-open hooks at 1675778566531 (+9 ms)Region opened successfully at 1675778566531 2023-02-07 14:02:46,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:46,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:46,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:46,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427., pid=24, masterSystemTime=1675778566499 2023-02-07 14:02:46,534 INFO [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:46,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:46,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:46,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:46,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4e403e3da79dd6bdefdf65e3b57bcd6f, NAME => 'testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-07 14:02:46,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:46,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:46,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:46,536 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=74a6ba96b740e3fd09a268bcd8453427, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:46,536 DEBUG [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1 2023-02-07 14:02:46,537 DEBUG [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1 2023-02-07 14:02:46,537 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566536"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778566536"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778566536"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778566536"}]},"ts":"1675778566536"} 2023-02-07 14:02:46,537 INFO [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6816d8c175af9806ef749579bd93cbf3 columnFamilyName f1 2023-02-07 14:02:46,538 INFO [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] regionserver.HStore(310): Store=6816d8c175af9806ef749579bd93cbf3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,538 INFO [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:46,538 INFO [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:46,542 DEBUG [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f/f1 2023-02-07 14:02:46,542 DEBUG [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f/f1 2023-02-07 14:02:46,543 INFO [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e403e3da79dd6bdefdf65e3b57bcd6f columnFamilyName f1 2023-02-07 14:02:46,544 DEBUG [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2 2023-02-07 14:02:46,544 DEBUG [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2 2023-02-07 14:02:46,544 INFO [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] regionserver.HStore(310): Store=4e403e3da79dd6bdefdf65e3b57bcd6f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,545 INFO [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:46,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-07 14:02:46,545 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 74a6ba96b740e3fd09a268bcd8453427, server=jenkins-hbase4.apache.org,42681,1675778562998 in 186 msec 2023-02-07 14:02:46,546 INFO [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6816d8c175af9806ef749579bd93cbf3 columnFamilyName f2 2023-02-07 14:02:46,547 INFO [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] regionserver.HStore(310): Store=6816d8c175af9806ef749579bd93cbf3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,548 DEBUG [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f/f2 2023-02-07 14:02:46,549 DEBUG [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f/f2 2023-02-07 14:02:46,549 INFO [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e403e3da79dd6bdefdf65e3b57bcd6f columnFamilyName f2 2023-02-07 14:02:46,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:46,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=74a6ba96b740e3fd09a268bcd8453427, ASSIGN in 368 msec 2023-02-07 14:02:46,551 INFO [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] regionserver.HStore(310): Store=4e403e3da79dd6bdefdf65e3b57bcd6f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:46,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:46,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:46,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:46,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:46,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:46,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:46,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:46,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6816d8c175af9806ef749579bd93cbf3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75313800, jitterRate=0.12226307392120361}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:46,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6816d8c175af9806ef749579bd93cbf3: Running coprocessor pre-open hook at 1675778566531Writing region info on filesystem at 1675778566531Initializing all the Stores at 1675778566534 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566534Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566534Cleaning up temporary data from old regions at 1675778566553 (+19 ms)Cleaning up detritus from prior splits at 1675778566553Running coprocessor post-open hooks at 1675778566561 (+8 ms)Region opened successfully at 1675778566561 2023-02-07 14:02:46,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:46,562 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3., pid=29, masterSystemTime=1675778566525 2023-02-07 14:02:46,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4e403e3da79dd6bdefdf65e3b57bcd6f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70224057, jitterRate=0.04641999304294586}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:46,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4e403e3da79dd6bdefdf65e3b57bcd6f: Running coprocessor pre-open hook at 1675778566537Writing region info on filesystem at 1675778566537Initializing all the Stores at 1675778566538 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566538Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566538Cleaning up temporary data from old regions at 1675778566555 (+17 ms)Cleaning up detritus from prior splits at 1675778566556 (+1 ms)Running coprocessor post-open hooks at 1675778566563 (+7 ms)Region opened successfully at 1675778566564 (+1 ms) 2023-02-07 14:02:46,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f., pid=23, masterSystemTime=1675778566499 2023-02-07 14:02:46,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:46,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:46,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:46,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3e8eb2655570dcc33e6f1d2553004acf, NAME => 'testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-07 14:02:46,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:46,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,568 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=6816d8c175af9806ef749579bd93cbf3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:46,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:46,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:46,568 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566567"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778566567"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778566567"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778566567"}]},"ts":"1675778566567"} 2023-02-07 14:02:46,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:46,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:46,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:46,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 45af8e26bbb35d3c7fbeb12766ba1e5c, NAME => 'testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-07 14:02:46,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:46,570 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=4e403e3da79dd6bdefdf65e3b57bcd6f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:46,576 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6816d8c175af9806ef749579bd93cbf3, ASSIGN in 397 msec 2023-02-07 14:02:46,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=19 2023-02-07 14:02:46,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,579 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778566570"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778566570"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778566570"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778566570"}]},"ts":"1675778566570"} 2023-02-07 14:02:46,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=19, state=SUCCESS; OpenRegionProcedure 6816d8c175af9806ef749579bd93cbf3, server=jenkins-hbase4.apache.org,35817,1675778562952 in 194 msec 2023-02-07 14:02:46,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:46,579 INFO [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:46,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:46,582 DEBUG [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1 2023-02-07 14:02:46,582 DEBUG [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1 2023-02-07 14:02:46,582 INFO [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:46,583 INFO [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e8eb2655570dcc33e6f1d2553004acf columnFamilyName f1 2023-02-07 14:02:46,584 INFO [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] regionserver.HStore(310): Store=3e8eb2655570dcc33e6f1d2553004acf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,584 INFO [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:46,585 DEBUG [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1 2023-02-07 14:02:46,586 DEBUG [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1 2023-02-07 14:02:46,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-07 14:02:46,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure 4e403e3da79dd6bdefdf65e3b57bcd6f, server=jenkins-hbase4.apache.org,42681,1675778562998 in 231 msec 2023-02-07 14:02:46,586 DEBUG [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2 2023-02-07 14:02:46,586 DEBUG [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2 2023-02-07 14:02:46,588 INFO [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45af8e26bbb35d3c7fbeb12766ba1e5c columnFamilyName f1 2023-02-07 14:02:46,588 INFO [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e8eb2655570dcc33e6f1d2553004acf columnFamilyName f2 2023-02-07 14:02:46,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4e403e3da79dd6bdefdf65e3b57bcd6f, ASSIGN in 409 msec 2023-02-07 14:02:46,590 INFO [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] regionserver.HStore(310): Store=3e8eb2655570dcc33e6f1d2553004acf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,592 INFO [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] regionserver.HStore(310): Store=45af8e26bbb35d3c7fbeb12766ba1e5c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,592 INFO [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:46,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:46,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:46,594 DEBUG [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2 2023-02-07 14:02:46,594 DEBUG [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2 2023-02-07 14:02:46,595 INFO [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45af8e26bbb35d3c7fbeb12766ba1e5c columnFamilyName f2 2023-02-07 14:02:46,597 INFO [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] regionserver.HStore(310): Store=45af8e26bbb35d3c7fbeb12766ba1e5c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:46,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:46,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:46,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:46,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:46,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:46,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3e8eb2655570dcc33e6f1d2553004acf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65344536, jitterRate=-0.026290535926818848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:46,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3e8eb2655570dcc33e6f1d2553004acf: Running coprocessor pre-open hook at 1675778566568Writing region info on filesystem at 1675778566568Initializing all the Stores at 1675778566570 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566570Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566578 (+8 ms)Cleaning up temporary data from old regions at 1675778566595 (+17 ms)Cleaning up detritus from prior splits at 1675778566596 (+1 ms)Running coprocessor post-open hooks at 1675778566605 (+9 ms)Region opened successfully at 1675778566605 2023-02-07 14:02:46,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:46,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf., pid=28, masterSystemTime=1675778566525 2023-02-07 14:02:46,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:46,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 45af8e26bbb35d3c7fbeb12766ba1e5c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70409851, jitterRate=0.04918853938579559}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:46,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 45af8e26bbb35d3c7fbeb12766ba1e5c: Running coprocessor pre-open hook at 1675778566580Writing region info on filesystem at 1675778566580Initializing all the Stores at 1675778566581 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566581Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566582 (+1 ms)Cleaning up temporary data from old regions at 1675778566601 (+19 ms)Cleaning up detritus from prior splits at 1675778566601Running coprocessor post-open hooks at 1675778566610 (+9 ms)Region opened successfully at 1675778566610 2023-02-07 14:02:46,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:46,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:46,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:46,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8691d855b35ad124573f3d9aa7a6c525, NAME => 'testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-07 14:02:46,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c., pid=22, masterSystemTime=1675778566499 2023-02-07 14:02:46,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:46,611 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3e8eb2655570dcc33e6f1d2553004acf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:46,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:46,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:46,611 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566611"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778566611"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778566611"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778566611"}]},"ts":"1675778566611"} 2023-02-07 14:02:46,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:46,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:46,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:46,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b3da998557027663b1b762e486d589c3, NAME => 'testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-07 14:02:46,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b3da998557027663b1b762e486d589c3 2023-02-07 14:02:46,615 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=45af8e26bbb35d3c7fbeb12766ba1e5c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:46,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b3da998557027663b1b762e486d589c3 2023-02-07 14:02:46,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b3da998557027663b1b762e486d589c3 2023-02-07 14:02:46,616 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566615"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778566615"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778566615"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778566615"}]},"ts":"1675778566615"} 2023-02-07 14:02:46,616 INFO [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:46,618 INFO [StoreOpener-b3da998557027663b1b762e486d589c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b3da998557027663b1b762e486d589c3 2023-02-07 14:02:46,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=13 2023-02-07 14:02:46,619 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=13, state=SUCCESS; OpenRegionProcedure 3e8eb2655570dcc33e6f1d2553004acf, server=jenkins-hbase4.apache.org,35817,1675778562952 in 244 msec 2023-02-07 14:02:46,619 DEBUG [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1 2023-02-07 14:02:46,619 DEBUG [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1 2023-02-07 14:02:46,620 INFO [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8691d855b35ad124573f3d9aa7a6c525 columnFamilyName f1 2023-02-07 14:02:46,621 DEBUG [StoreOpener-b3da998557027663b1b762e486d589c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1 2023-02-07 14:02:46,621 DEBUG [StoreOpener-b3da998557027663b1b762e486d589c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1 2023-02-07 14:02:46,621 INFO [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] regionserver.HStore(310): Store=8691d855b35ad124573f3d9aa7a6c525/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,621 INFO [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:46,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3e8eb2655570dcc33e6f1d2553004acf, ASSIGN in 442 msec 2023-02-07 14:02:46,622 INFO [StoreOpener-b3da998557027663b1b762e486d589c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3da998557027663b1b762e486d589c3 columnFamilyName f1 2023-02-07 14:02:46,622 INFO [StoreOpener-b3da998557027663b1b762e486d589c3-1] regionserver.HStore(310): Store=b3da998557027663b1b762e486d589c3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=14 2023-02-07 14:02:46,623 INFO [StoreOpener-b3da998557027663b1b762e486d589c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b3da998557027663b1b762e486d589c3 2023-02-07 14:02:46,623 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=14, state=SUCCESS; OpenRegionProcedure 45af8e26bbb35d3c7fbeb12766ba1e5c, server=jenkins-hbase4.apache.org,42681,1675778562998 in 271 msec 2023-02-07 14:02:46,624 DEBUG [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2 2023-02-07 14:02:46,624 DEBUG [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2 2023-02-07 14:02:46,625 INFO [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8691d855b35ad124573f3d9aa7a6c525 columnFamilyName f2 2023-02-07 14:02:46,625 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=45af8e26bbb35d3c7fbeb12766ba1e5c, ASSIGN in 446 msec 2023-02-07 14:02:46,626 INFO [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] regionserver.HStore(310): Store=8691d855b35ad124573f3d9aa7a6c525/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,626 DEBUG [StoreOpener-b3da998557027663b1b762e486d589c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2 2023-02-07 14:02:46,627 DEBUG [StoreOpener-b3da998557027663b1b762e486d589c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2 2023-02-07 14:02:46,627 INFO [StoreOpener-b3da998557027663b1b762e486d589c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3da998557027663b1b762e486d589c3 columnFamilyName f2 2023-02-07 14:02:46,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:46,628 INFO [StoreOpener-b3da998557027663b1b762e486d589c3-1] regionserver.HStore(310): Store=b3da998557027663b1b762e486d589c3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:46,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3 2023-02-07 14:02:46,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3 2023-02-07 14:02:46,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:46,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:46,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b3da998557027663b1b762e486d589c3 2023-02-07 14:02:46,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:46,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:46,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b3da998557027663b1b762e486d589c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62646991, jitterRate=-0.06648708879947662}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:46,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b3da998557027663b1b762e486d589c3: Running coprocessor pre-open hook at 1675778566616Writing region info on filesystem at 1675778566616Initializing all the Stores at 1675778566618 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566618Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566618Cleaning up temporary data from old regions at 1675778566670 (+52 ms)Cleaning up detritus from prior splits at 1675778566671 (+1 ms)Running coprocessor post-open hooks at 1675778566682 (+11 ms)Region opened successfully at 1675778566682 2023-02-07 14:02:46,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3., pid=21, masterSystemTime=1675778566499 2023-02-07 14:02:46,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:46,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8691d855b35ad124573f3d9aa7a6c525; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71374494, jitterRate=0.06356284022331238}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:46,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8691d855b35ad124573f3d9aa7a6c525: Running coprocessor pre-open hook at 1675778566612Writing region info on filesystem at 1675778566612Initializing all the Stores at 1675778566616 (+4 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566616Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566616Cleaning up temporary data from old regions at 1675778566669 (+53 ms)Cleaning up detritus from prior splits at 1675778566669Running coprocessor post-open hooks at 1675778566685 (+16 ms)Region opened successfully at 1675778566685 2023-02-07 14:02:46,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525., pid=26, masterSystemTime=1675778566525 2023-02-07 14:02:46,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:46,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:46,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:46,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 02dbd90de942d8345117748d1abdcdd3, NAME => 'testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-07 14:02:46,687 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=b3da998557027663b1b762e486d589c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:46,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:46,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,688 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566687"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778566687"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778566687"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778566687"}]},"ts":"1675778566687"} 2023-02-07 14:02:46,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:46,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:46,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:46,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:46,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:46,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e9a23cbdeed13f0100ce5ce7445e651a, NAME => 'testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-07 14:02:46,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:46,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:46,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:46,691 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=8691d855b35ad124573f3d9aa7a6c525, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:46,691 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566691"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778566691"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778566691"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778566691"}]},"ts":"1675778566691"} 2023-02-07 14:02:46,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=18 2023-02-07 14:02:46,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=18, state=SUCCESS; OpenRegionProcedure b3da998557027663b1b762e486d589c3, server=jenkins-hbase4.apache.org,42681,1675778562998 in 347 msec 2023-02-07 14:02:46,696 INFO [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:46,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-07 14:02:46,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure 8691d855b35ad124573f3d9aa7a6c525, server=jenkins-hbase4.apache.org,35817,1675778562952 in 332 msec 2023-02-07 14:02:46,699 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b3da998557027663b1b762e486d589c3, ASSIGN in 518 msec 2023-02-07 14:02:46,699 INFO [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:46,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8691d855b35ad124573f3d9aa7a6c525, ASSIGN in 520 msec 2023-02-07 14:02:46,701 DEBUG [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3/f1 2023-02-07 14:02:46,701 DEBUG [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3/f1 2023-02-07 14:02:46,701 DEBUG [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1 2023-02-07 14:02:46,702 INFO [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02dbd90de942d8345117748d1abdcdd3 columnFamilyName f1 2023-02-07 14:02:46,702 DEBUG [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1 2023-02-07 14:02:46,702 INFO [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9a23cbdeed13f0100ce5ce7445e651a columnFamilyName f1 2023-02-07 14:02:46,703 INFO [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] regionserver.HStore(310): Store=02dbd90de942d8345117748d1abdcdd3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,703 INFO [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:46,703 INFO [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] regionserver.HStore(310): Store=e9a23cbdeed13f0100ce5ce7445e651a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,703 INFO [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:46,705 DEBUG [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2 2023-02-07 14:02:46,705 DEBUG [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2 2023-02-07 14:02:46,706 DEBUG [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3/f2 2023-02-07 14:02:46,706 INFO [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9a23cbdeed13f0100ce5ce7445e651a columnFamilyName f2 2023-02-07 14:02:46,706 DEBUG [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3/f2 2023-02-07 14:02:46,706 INFO [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02dbd90de942d8345117748d1abdcdd3 columnFamilyName f2 2023-02-07 14:02:46,707 INFO [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] regionserver.HStore(310): Store=e9a23cbdeed13f0100ce5ce7445e651a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,708 INFO [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] regionserver.HStore(310): Store=02dbd90de942d8345117748d1abdcdd3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:46,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:46,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:46,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:46,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:46,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:46,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:46,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:46,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:46,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:46,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 02dbd90de942d8345117748d1abdcdd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60084613, jitterRate=-0.1046694964170456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:46,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 02dbd90de942d8345117748d1abdcdd3: Running coprocessor pre-open hook at 1675778566688Writing region info on filesystem at 1675778566688Initializing all the Stores at 1675778566689 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566689Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566696 (+7 ms)Cleaning up temporary data from old regions at 1675778566712 (+16 ms)Cleaning up detritus from prior splits at 1675778566713 (+1 ms)Running coprocessor post-open hooks at 1675778566724 (+11 ms)Region opened successfully at 1675778566724 2023-02-07 14:02:46,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e9a23cbdeed13f0100ce5ce7445e651a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69563815, jitterRate=0.0365816205739975}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:46,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e9a23cbdeed13f0100ce5ce7445e651a: Running coprocessor pre-open hook at 1675778566690Writing region info on filesystem at 1675778566690Initializing all the Stores at 1675778566691 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566692 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566699 (+7 ms)Cleaning up temporary data from old regions at 1675778566712 (+13 ms)Cleaning up detritus from prior splits at 1675778566713 (+1 ms)Running coprocessor post-open hooks at 1675778566725 (+12 ms)Region opened successfully at 1675778566725 2023-02-07 14:02:46,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3., pid=25, masterSystemTime=1675778566499 2023-02-07 14:02:46,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a., pid=27, masterSystemTime=1675778566525 2023-02-07 14:02:46,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:46,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:46,729 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=02dbd90de942d8345117748d1abdcdd3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:46,730 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778566729"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778566729"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778566729"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778566729"}]},"ts":"1675778566729"} 2023-02-07 14:02:46,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:46,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:46,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:46,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e1cdf44635ff1b97044d6263fbaa981a, NAME => 'testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-07 14:02:46,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:46,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:46,730 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e9a23cbdeed13f0100ce5ce7445e651a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:46,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:46,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:46,731 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566730"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778566730"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778566730"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778566730"}]},"ts":"1675778566730"} 2023-02-07 14:02:46,733 INFO [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:46,736 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-07 14:02:46,736 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure 02dbd90de942d8345117748d1abdcdd3, server=jenkins-hbase4.apache.org,42681,1675778562998 in 375 msec 2023-02-07 14:02:46,736 DEBUG [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1 2023-02-07 14:02:46,736 DEBUG [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1 2023-02-07 14:02:46,737 INFO [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1cdf44635ff1b97044d6263fbaa981a columnFamilyName f1 2023-02-07 14:02:46,738 INFO [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] regionserver.HStore(310): Store=e1cdf44635ff1b97044d6263fbaa981a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=12 2023-02-07 14:02:46,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=12, state=SUCCESS; OpenRegionProcedure e9a23cbdeed13f0100ce5ce7445e651a, server=jenkins-hbase4.apache.org,35817,1675778562952 in 370 msec 2023-02-07 14:02:46,738 INFO [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:46,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=02dbd90de942d8345117748d1abdcdd3, ASSIGN in 559 msec 2023-02-07 14:02:46,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e9a23cbdeed13f0100ce5ce7445e651a, ASSIGN in 561 msec 2023-02-07 14:02:46,740 DEBUG [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2 2023-02-07 14:02:46,740 DEBUG [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2 2023-02-07 14:02:46,741 INFO [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1cdf44635ff1b97044d6263fbaa981a columnFamilyName f2 2023-02-07 14:02:46,742 INFO [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] regionserver.HStore(310): Store=e1cdf44635ff1b97044d6263fbaa981a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:46,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:46,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:46,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:46,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:46,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:46,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e1cdf44635ff1b97044d6263fbaa981a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63007949, jitterRate=-0.06110839545726776}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:46,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e1cdf44635ff1b97044d6263fbaa981a: Running coprocessor pre-open hook at 1675778566731Writing region info on filesystem at 1675778566731Initializing all the Stores at 1675778566732 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566732Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778566732Cleaning up temporary data from old regions at 1675778566745 (+13 ms)Cleaning up detritus from prior splits at 1675778566746 (+1 ms)Running coprocessor post-open hooks at 1675778566753 (+7 ms)Region opened successfully at 1675778566753 2023-02-07 14:02:46,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a., pid=30, masterSystemTime=1675778566525 2023-02-07 14:02:46,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:46,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:46,757 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=e1cdf44635ff1b97044d6263fbaa981a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:46,757 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778566757"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778566757"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778566757"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778566757"}]},"ts":"1675778566757"} 2023-02-07 14:02:46,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-07 14:02:46,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure e1cdf44635ff1b97044d6263fbaa981a, server=jenkins-hbase4.apache.org,35817,1675778562952 in 376 msec 2023-02-07 14:02:46,766 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=10 2023-02-07 14:02:46,766 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e1cdf44635ff1b97044d6263fbaa981a, ASSIGN in 586 msec 2023-02-07 14:02:46,767 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:02:46,767 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778566767"}]},"ts":"1675778566767"} 2023-02-07 14:02:46,769 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-07 14:02:46,772 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:02:46,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 910 msec 2023-02-07 14:02:47,020 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:47,020 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:47,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:02:47,023 INFO [Listener at localhost/40837] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-07 14:02:47,023 DEBUG [Listener at localhost/40837] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-07 14:02:47,025 INFO [Listener at localhost/40837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:02:47,034 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-07 14:02:47,034 INFO [Listener at localhost/40837] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:02:47,034 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-07 14:02:47,034 INFO [Listener at localhost/40837] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 14:02:47,164 DEBUG [hconnection-0x2c01b7e-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:02:47,234 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:02:47,260 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42681] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:47,281 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35817] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:47,583 INFO [Listener at localhost/40837] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 14:02:47,587 INFO [Listener at localhost/40837] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 14:02:47,596 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:47,597 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:47,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 14:02:47,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675778567600 (current time:1675778567600). 2023-02-07 14:02:47,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 14:02:47,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] zookeeper.ReadOnlyZKClient(139): Connect 0x0554a9b9 to 127.0.0.1:55354 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:02:47,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@250ff9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:02:47,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:02:47,615 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49250, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:02:47,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0554a9b9 to 127.0.0.1:55354 2023-02-07 14:02:47,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:02:47,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 14:02:47,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 14:02:47,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 14:02:47,644 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 14:02:47,646 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675779167646 2023-02-07 14:02:47,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 14:02:47,647 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-07 14:02:47,648 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 14:02:47,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 14:02:47,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 12 msec 2023-02-07 14:02:47,653 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 14:02:47,653 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 14:02:47,653 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 14:02:47,654 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675779167654 2023-02-07 14:02:47,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-07 14:02:47,685 INFO [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-07 14:02:47,686 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:02:47,686 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-07 14:02:47,686 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-07 14:02:47,687 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:47,687 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 14:02:47,689 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:02:47,689 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:02:47,689 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:47,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:02:47,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:02:47,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:02:47,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:02:47,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 14:02:47,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:47,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-07 14:02:47,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 14:02:47,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-07 14:02:47,697 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:47,697 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:47,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 14:02:47,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-07 14:02:47,698 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:47,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:47,698 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-07 14:02:47,698 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:02:47,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-07 14:02:47,698 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:02:47,699 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 14:02:47,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 14:02:47,699 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-07 14:02:47,700 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-07 14:02:47,700 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35817,1675778562952' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-07 14:02:47,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-07 14:02:47,708 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-07 14:02:47,708 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:02:47,708 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 14:02:47,708 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-07 14:02:47,708 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42681,1675778562998' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-07 14:02:47,709 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:47,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:47,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:02:47,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:02:47,710 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:47,710 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 14:02:47,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:02:47,711 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 14:02:47,711 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:02:47,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:02:47,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 14:02:47,712 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 14:02:47,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:47,712 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 14:02:47,713 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:02:47,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:47,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:02:47,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35817,1675778562952' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-07 14:02:47,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a5692a[Count = 1] remaining members to acquire global barrier 2023-02-07 14:02:47,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:47,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:02:47,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:02:47,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:02:47,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:02:47,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 14:02:47,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:47,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:47,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:02:47,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42681,1675778562998' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-07 14:02:47,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a5692a[Count = 0] remaining members to acquire global barrier 2023-02-07 14:02:47,720 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-07 14:02:47,720 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 14:02:47,723 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 14:02:47,723 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 14:02:47,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 14:02:47,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 14:02:47,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 14:02:47,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 14:02:47,723 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 14:02:47,723 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:47,723 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 14:02:47,724 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:47,724 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:02:47,726 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:47,726 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:47,727 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. started... 2023-02-07 14:02:47,727 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. started... 2023-02-07 14:02:47,728 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:47,729 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e9a23cbdeed13f0100ce5ce7445e651a 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 14:02:47,729 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. started... 2023-02-07 14:02:47,729 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:47,729 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. started... 2023-02-07 14:02:47,730 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4e403e3da79dd6bdefdf65e3b57bcd6f: 2023-02-07 14:02:47,731 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:47,735 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 14:02:47,735 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 14:02:47,735 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 14:02:47,735 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 14:02:47,736 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:47,736 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. started... 2023-02-07 14:02:47,737 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:47,737 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 74a6ba96b740e3fd09a268bcd8453427 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:02:47,737 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. started... 2023-02-07 14:02:47,737 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e1cdf44635ff1b97044d6263fbaa981a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:02:47,738 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 6816d8c175af9806ef749579bd93cbf3 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 14:02:47,737 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 02dbd90de942d8345117748d1abdcdd3: 2023-02-07 14:02:47,740 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:47,740 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:02:47,740 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:02:47,745 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 14:02:47,745 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 14:02:47,745 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 14:02:47,745 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 14:02:47,753 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:02:47,754 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:47,754 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:47,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 14:02:47,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:02:47,759 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 14:02:47,796 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. completed. 2023-02-07 14:02:47,796 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:47,798 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:47,798 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 14:02:47,798 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. started... 2023-02-07 14:02:47,806 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] regionserver.HRegion(2744): Flushing b3da998557027663b1b762e486d589c3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:02:47,815 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. completed. 2023-02-07 14:02:47,816 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:47,816 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:47,816 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 14:02:47,816 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. started... 2023-02-07 14:02:47,817 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 45af8e26bbb35d3c7fbeb12766ba1e5c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:02:47,960 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:02:47,960 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:47,960 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:47,960 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/.tmp/f1/a26c28bb5f134693961d1d3e93909d2d 2023-02-07 14:02:47,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 14:02:47,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:02:47,963 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-07 14:02:47,965 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/.tmp/f1/1151a8a727424ea69ea0047302a18f1d 2023-02-07 14:02:47,982 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/.tmp/f1/10f1ba8634e9436a924737c32cad653d 2023-02-07 14:02:47,982 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/.tmp/f1/905021f88ab14c8e8d221abf34af39b7 2023-02-07 14:02:47,994 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/.tmp/f1/d21ce6d709b74791a5a3f9b6a4c29180 2023-02-07 14:02:47,994 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/.tmp/f1/4144f0ea70484a79b7f4f9e2e3ca89d7 2023-02-07 14:02:48,178 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/.tmp/f2/6ea6c77ef27e489eb839537e38e8c93d 2023-02-07 14:02:48,190 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/.tmp/f1/d21ce6d709b74791a5a3f9b6a4c29180 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1/d21ce6d709b74791a5a3f9b6a4c29180 2023-02-07 14:02:48,201 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/.tmp/f2/802a3a2619df4efbba1e338f1df0abc4 2023-02-07 14:02:48,203 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/.tmp/f2/328c20d1d3004e378680c989083bf634 2023-02-07 14:02:48,204 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/.tmp/f2/dd5a6d74a24444888657308b54817c11 2023-02-07 14:02:48,209 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1/d21ce6d709b74791a5a3f9b6a4c29180, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:02:48,212 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/.tmp/f2/6ea6c77ef27e489eb839537e38e8c93d as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2/6ea6c77ef27e489eb839537e38e8c93d 2023-02-07 14:02:48,213 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/.tmp/f1/905021f88ab14c8e8d221abf34af39b7 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1/905021f88ab14c8e8d221abf34af39b7 2023-02-07 14:02:48,214 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/.tmp/f1/4144f0ea70484a79b7f4f9e2e3ca89d7 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1/4144f0ea70484a79b7f4f9e2e3ca89d7 2023-02-07 14:02:48,215 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/.tmp/f1/10f1ba8634e9436a924737c32cad653d as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1/10f1ba8634e9436a924737c32cad653d 2023-02-07 14:02:48,223 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1/10f1ba8634e9436a924737c32cad653d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:02:48,225 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1/905021f88ab14c8e8d221abf34af39b7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:02:48,225 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/.tmp/f2/802a3a2619df4efbba1e338f1df0abc4 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2/802a3a2619df4efbba1e338f1df0abc4 2023-02-07 14:02:48,227 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/.tmp/f2/328c20d1d3004e378680c989083bf634 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2/328c20d1d3004e378680c989083bf634 2023-02-07 14:02:48,228 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2/6ea6c77ef27e489eb839537e38e8c93d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:02:48,229 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 74a6ba96b740e3fd09a268bcd8453427 in 492ms, sequenceid=5, compaction requested=false 2023-02-07 14:02:48,230 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1/4144f0ea70484a79b7f4f9e2e3ca89d7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:02:48,232 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-07 14:02:48,234 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/.tmp/f2/dd5a6d74a24444888657308b54817c11 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2/dd5a6d74a24444888657308b54817c11 2023-02-07 14:02:48,234 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 74a6ba96b740e3fd09a268bcd8453427: 2023-02-07 14:02:48,234 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,234 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:02:48,235 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1/d21ce6d709b74791a5a3f9b6a4c29180] hfiles 2023-02-07 14:02:48,235 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1/d21ce6d709b74791a5a3f9b6a4c29180 for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,235 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2/802a3a2619df4efbba1e338f1df0abc4, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:02:48,236 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b3da998557027663b1b762e486d589c3 in 430ms, sequenceid=5, compaction requested=false 2023-02-07 14:02:48,237 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b3da998557027663b1b762e486d589c3: 2023-02-07 14:02:48,238 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,238 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:02:48,238 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1/10f1ba8634e9436a924737c32cad653d] hfiles 2023-02-07 14:02:48,238 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1/10f1ba8634e9436a924737c32cad653d for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,238 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2/328c20d1d3004e378680c989083bf634, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:02:48,239 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e1cdf44635ff1b97044d6263fbaa981a in 502ms, sequenceid=5, compaction requested=false 2023-02-07 14:02:48,239 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e1cdf44635ff1b97044d6263fbaa981a: 2023-02-07 14:02:48,239 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,239 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:02:48,239 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1/905021f88ab14c8e8d221abf34af39b7] hfiles 2023-02-07 14:02:48,239 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1/905021f88ab14c8e8d221abf34af39b7 for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,241 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2/6ea6c77ef27e489eb839537e38e8c93d] hfiles 2023-02-07 14:02:48,241 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2/6ea6c77ef27e489eb839537e38e8c93d for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,241 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2/328c20d1d3004e378680c989083bf634] hfiles 2023-02-07 14:02:48,241 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2/802a3a2619df4efbba1e338f1df0abc4] hfiles 2023-02-07 14:02:48,241 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2/328c20d1d3004e378680c989083bf634 for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,241 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2/802a3a2619df4efbba1e338f1df0abc4 for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,244 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2/dd5a6d74a24444888657308b54817c11, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:02:48,250 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 45af8e26bbb35d3c7fbeb12766ba1e5c in 433ms, sequenceid=5, compaction requested=false 2023-02-07 14:02:48,251 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 45af8e26bbb35d3c7fbeb12766ba1e5c: 2023-02-07 14:02:48,251 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,251 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:02:48,251 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1/4144f0ea70484a79b7f4f9e2e3ca89d7] hfiles 2023-02-07 14:02:48,251 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1/4144f0ea70484a79b7f4f9e2e3ca89d7 for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,251 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2/dd5a6d74a24444888657308b54817c11] hfiles 2023-02-07 14:02:48,251 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2/dd5a6d74a24444888657308b54817c11 for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,263 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:02:48,263 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:48,263 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:48,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 14:02:48,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:02:48,269 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-07 14:02:48,274 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. completed. 2023-02-07 14:02:48,274 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:48,275 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. completed. 2023-02-07 14:02:48,275 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 14:02:48,275 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:48,275 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:48,275 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 14:02:48,275 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. started... 2023-02-07 14:02:48,276 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3e8eb2655570dcc33e6f1d2553004acf 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:02:48,278 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. completed. 2023-02-07 14:02:48,278 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:48,278 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 14:02:48,301 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/.tmp/f1/78221aa9e37e459e8fe449828051c4aa 2023-02-07 14:02:48,331 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/.tmp/f2/8cf0d0575a3b4c9c8a22d0f657314094 2023-02-07 14:02:48,340 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/.tmp/f1/78221aa9e37e459e8fe449828051c4aa as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1/78221aa9e37e459e8fe449828051c4aa 2023-02-07 14:02:48,347 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1/78221aa9e37e459e8fe449828051c4aa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:02:48,349 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/.tmp/f2/8cf0d0575a3b4c9c8a22d0f657314094 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2/8cf0d0575a3b4c9c8a22d0f657314094 2023-02-07 14:02:48,357 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2/8cf0d0575a3b4c9c8a22d0f657314094, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:02:48,358 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3e8eb2655570dcc33e6f1d2553004acf in 82ms, sequenceid=5, compaction requested=false 2023-02-07 14:02:48,358 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3e8eb2655570dcc33e6f1d2553004acf: 2023-02-07 14:02:48,368 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,368 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:02:48,368 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1/78221aa9e37e459e8fe449828051c4aa] hfiles 2023-02-07 14:02:48,368 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1/78221aa9e37e459e8fe449828051c4aa for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,368 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2/8cf0d0575a3b4c9c8a22d0f657314094] hfiles 2023-02-07 14:02:48,368 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2/8cf0d0575a3b4c9c8a22d0f657314094 for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,393 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. completed. 2023-02-07 14:02:48,393 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:48,393 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 14:02:48,393 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:48,393 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. started... 2023-02-07 14:02:48,394 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 8691d855b35ad124573f3d9aa7a6c525 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:02:48,426 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/.tmp/f1/a3dcbaa429e1465f9d07fadad231ce54 2023-02-07 14:02:48,456 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/.tmp/f2/21ef149e36644b81bac544390e1b44a3 2023-02-07 14:02:48,464 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/.tmp/f1/a3dcbaa429e1465f9d07fadad231ce54 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1/a3dcbaa429e1465f9d07fadad231ce54 2023-02-07 14:02:48,472 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1/a3dcbaa429e1465f9d07fadad231ce54, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:02:48,473 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/.tmp/f2/21ef149e36644b81bac544390e1b44a3 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2/21ef149e36644b81bac544390e1b44a3 2023-02-07 14:02:48,482 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2/21ef149e36644b81bac544390e1b44a3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:02:48,483 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8691d855b35ad124573f3d9aa7a6c525 in 89ms, sequenceid=5, compaction requested=false 2023-02-07 14:02:48,483 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8691d855b35ad124573f3d9aa7a6c525: 2023-02-07 14:02:48,483 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,483 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:02:48,483 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1/a3dcbaa429e1465f9d07fadad231ce54] hfiles 2023-02-07 14:02:48,483 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1/a3dcbaa429e1465f9d07fadad231ce54 for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,483 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2/21ef149e36644b81bac544390e1b44a3] hfiles 2023-02-07 14:02:48,483 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2/21ef149e36644b81bac544390e1b44a3 for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,507 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. completed. 2023-02-07 14:02:48,507 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:48,507 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 14:02:48,597 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/.tmp/f2/00d674550f3c4a8eb3430697a3c0e9e0 2023-02-07 14:02:48,604 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/.tmp/f2/3afb7cb49ca144c396b1aec27d1f35f9 2023-02-07 14:02:48,616 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/.tmp/f1/1151a8a727424ea69ea0047302a18f1d as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1/1151a8a727424ea69ea0047302a18f1d 2023-02-07 14:02:48,623 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/.tmp/f1/a26c28bb5f134693961d1d3e93909d2d as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1/a26c28bb5f134693961d1d3e93909d2d 2023-02-07 14:02:48,624 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1/1151a8a727424ea69ea0047302a18f1d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 14:02:48,626 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/.tmp/f2/00d674550f3c4a8eb3430697a3c0e9e0 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2/00d674550f3c4a8eb3430697a3c0e9e0 2023-02-07 14:02:48,630 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1/a26c28bb5f134693961d1d3e93909d2d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 14:02:48,631 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/.tmp/f2/3afb7cb49ca144c396b1aec27d1f35f9 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2/3afb7cb49ca144c396b1aec27d1f35f9 2023-02-07 14:02:48,634 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2/00d674550f3c4a8eb3430697a3c0e9e0, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 14:02:48,636 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 6816d8c175af9806ef749579bd93cbf3 in 897ms, sequenceid=5, compaction requested=false 2023-02-07 14:02:48,636 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 6816d8c175af9806ef749579bd93cbf3: 2023-02-07 14:02:48,636 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,636 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:02:48,636 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1/1151a8a727424ea69ea0047302a18f1d] hfiles 2023-02-07 14:02:48,636 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1/1151a8a727424ea69ea0047302a18f1d for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,636 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2/00d674550f3c4a8eb3430697a3c0e9e0] hfiles 2023-02-07 14:02:48,636 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2/00d674550f3c4a8eb3430697a3c0e9e0 for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,641 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2/3afb7cb49ca144c396b1aec27d1f35f9, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 14:02:48,643 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e9a23cbdeed13f0100ce5ce7445e651a in 915ms, sequenceid=5, compaction requested=false 2023-02-07 14:02:48,643 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e9a23cbdeed13f0100ce5ce7445e651a: 2023-02-07 14:02:48,643 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,643 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:02:48,643 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1/a26c28bb5f134693961d1d3e93909d2d] hfiles 2023-02-07 14:02:48,643 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1/a26c28bb5f134693961d1d3e93909d2d for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,643 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2/3afb7cb49ca144c396b1aec27d1f35f9] hfiles 2023-02-07 14:02:48,643 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2/3afb7cb49ca144c396b1aec27d1f35f9 for snapshot=testWithMapReduceMultiRegion 2023-02-07 14:02:48,648 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. completed. 2023-02-07 14:02:48,648 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:48,648 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 14:02:48,651 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. completed. 2023-02-07 14:02:48,651 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:48,652 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 14:02:48,652 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 14:02:48,652 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:48,652 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-07 14:02:48,652 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35817,1675778562952' in zk 2023-02-07 14:02:48,656 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:48,656 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-07 14:02:48,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:48,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:02:48,656 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:02:48,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:02:48,656 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-07 14:02:48,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:02:48,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:02:48,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 14:02:48,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:48,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:48,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:02:48,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 14:02:48,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:48,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35817,1675778562952': 2023-02-07 14:02:48,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35817,1675778562952' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-07 14:02:48,667 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. completed. 2023-02-07 14:02:48,667 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:48,667 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 14:02:48,667 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 14:02:48,667 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:48,668 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-07 14:02:48,668 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,42681,1675778562998' in zk 2023-02-07 14:02:48,670 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:48,670 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-07 14:02:48,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:48,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:02:48,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:02:48,670 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:02:48,670 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-07 14:02:48,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:02:48,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:02:48,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 14:02:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:48,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:02:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 14:02:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,42681,1675778562998': 2023-02-07 14:02:48,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42681,1675778562998' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-07 14:02:48,676 INFO [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-07 14:02:48,676 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:02:48,676 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:02:48,676 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-07 14:02:48,676 INFO [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 14:02:48,679 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:48,679 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:02:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:02:48,679 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:48,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:48,679 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:02:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:48,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:48,679 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:02:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:02:48,680 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:48,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:02:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:02:48,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:02:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:02:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 14:02:48,680 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:02:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 14:02:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:48,682 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:02:48,683 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-07 14:02:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:48,697 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:48,697 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:02:48,697 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 14:02:48,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:02:48,697 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:48,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:02:48,697 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:02:48,697 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:02:48,697 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-07 14:02:48,697 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-07 14:02:48,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:02:48,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:02:48,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-07 14:02:48,697 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:48,698 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 14:02:48,698 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:48,698 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-07 14:02:48,698 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-07 14:02:48,697 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:02:48,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:02:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:02:48,697 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:02:48,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:02:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:02:48,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-07 14:02:48,770 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:02:48,770 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:48,770 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:48,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 14:02:48,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:02:48,772 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-07 14:02:48,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-07 14:02:48,821 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-07 14:02:48,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-07 14:02:48,821 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-07 14:02:48,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675778567647Consolidate snapshot: testWithMapReduceMultiRegion at 1675778568697 (+1050 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1675778568698 (+1 ms)Writing data manifest for testWithMapReduceMultiRegion at 1675778568717 (+19 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1675778568748 (+31 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1675778568821 (+73 ms) 2023-02-07 14:02:48,822 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 14:02:48,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1730 sec 2023-02-07 14:02:49,772 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:02:49,772 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:49,772 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:49,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 14:02:49,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 14:02:49,774 INFO [Listener at localhost/40837] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 14:02:49,775 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:49,775 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:49,788 INFO [Listener at localhost/40837] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 14:02:49,813 INFO [Listener at localhost/40837] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 14:02:49,889 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42681] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:49,916 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35817] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:50,021 INFO [Listener at localhost/40837] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 14:02:50,036 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:50,036 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:50,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 14:02:50,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-07 14:02:50,044 INFO [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-07 14:02:50,044 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:02:50,045 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-07 14:02:50,045 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-07 14:02:50,045 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,045 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:02:50,046 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:02:50,047 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:02:50,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:02:50,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:02:50,047 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:02:50,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:02:50,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:02:50,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:02:50,048 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,048 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,048 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,048 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:02:50,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:02:50,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:02:50,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:02:50,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:02:50,049 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 14:02:50,049 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 14:02:50,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 14:02:50,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 14:02:50,056 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 14:02:50,056 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 14:02:50,056 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:02:50,056 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:02:50,057 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 14:02:50,057 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 14:02:50,060 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:50,060 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. started... 2023-02-07 14:02:50,060 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:50,060 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:50,060 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e9a23cbdeed13f0100ce5ce7445e651a 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 14:02:50,060 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. started... 2023-02-07 14:02:50,060 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:50,060 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. started... 2023-02-07 14:02:50,060 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 14:02:50,061 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 14:02:50,061 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e1cdf44635ff1b97044d6263fbaa981a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:02:50,061 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:50,061 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. started... 2023-02-07 14:02:50,061 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 02dbd90de942d8345117748d1abdcdd3: 2023-02-07 14:02:50,061 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:50,061 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 14:02:50,061 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:50,060 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4e403e3da79dd6bdefdf65e3b57bcd6f: 2023-02-07 14:02:50,060 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. started... 2023-02-07 14:02:50,061 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 14:02:50,061 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:50,061 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. started... 2023-02-07 14:02:50,062 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:50,062 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 14:02:50,062 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 74a6ba96b740e3fd09a268bcd8453427 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:02:50,062 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 14:02:50,062 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. started... 2023-02-07 14:02:50,063 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 45af8e26bbb35d3c7fbeb12766ba1e5c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:02:50,062 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b3da998557027663b1b762e486d589c3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:02:50,062 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:50,065 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. started... 2023-02-07 14:02:50,066 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6816d8c175af9806ef749579bd93cbf3 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 14:02:50,130 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/.tmp/f1/4549f6757c38475997008fb13b8dc71c 2023-02-07 14:02:50,136 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/.tmp/f1/e520c455977c400a969f1887fb268c00 2023-02-07 14:02:50,139 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/.tmp/f1/ff025e92c92b4f1988e3d4d115f68b02 2023-02-07 14:02:50,164 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/.tmp/f1/46991fbc73244343a3f208783672d679 2023-02-07 14:02:50,178 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/.tmp/f2/be67593c7c31441ebf4376c37b91ab5e 2023-02-07 14:02:50,182 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/.tmp/f2/7bd9b6fcddaa4358a014d76e83a1222d 2023-02-07 14:02:50,185 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/.tmp/f2/d843494f89674616ac927523d0f70e8b 2023-02-07 14:02:50,188 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/.tmp/f1/ff025e92c92b4f1988e3d4d115f68b02 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1/ff025e92c92b4f1988e3d4d115f68b02 2023-02-07 14:02:50,193 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/.tmp/f1/e520c455977c400a969f1887fb268c00 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1/e520c455977c400a969f1887fb268c00 2023-02-07 14:02:50,194 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/.tmp/f1/4549f6757c38475997008fb13b8dc71c as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1/4549f6757c38475997008fb13b8dc71c 2023-02-07 14:02:50,197 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/.tmp/f2/ca8f6eeaeeba4b18a9ba2584afc4ee36 2023-02-07 14:02:50,201 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1/ff025e92c92b4f1988e3d4d115f68b02, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:02:50,202 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1/e520c455977c400a969f1887fb268c00, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:02:50,202 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/.tmp/f2/be67593c7c31441ebf4376c37b91ab5e as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2/be67593c7c31441ebf4376c37b91ab5e 2023-02-07 14:02:50,204 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/.tmp/f2/d843494f89674616ac927523d0f70e8b as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2/d843494f89674616ac927523d0f70e8b 2023-02-07 14:02:50,204 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1/4549f6757c38475997008fb13b8dc71c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 14:02:50,205 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/.tmp/f1/46991fbc73244343a3f208783672d679 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1/46991fbc73244343a3f208783672d679 2023-02-07 14:02:50,205 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/.tmp/f2/7bd9b6fcddaa4358a014d76e83a1222d as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2/7bd9b6fcddaa4358a014d76e83a1222d 2023-02-07 14:02:50,210 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2/be67593c7c31441ebf4376c37b91ab5e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:02:50,212 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e1cdf44635ff1b97044d6263fbaa981a in 150ms, sequenceid=9, compaction requested=false 2023-02-07 14:02:50,212 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e1cdf44635ff1b97044d6263fbaa981a: 2023-02-07 14:02:50,212 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:50,212 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:50,212 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 14:02:50,212 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. started... 2023-02-07 14:02:50,212 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 3e8eb2655570dcc33e6f1d2553004acf 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:02:50,213 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2/d843494f89674616ac927523d0f70e8b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:02:50,215 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 74a6ba96b740e3fd09a268bcd8453427 in 154ms, sequenceid=9, compaction requested=false 2023-02-07 14:02:50,215 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 74a6ba96b740e3fd09a268bcd8453427: 2023-02-07 14:02:50,215 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:50,215 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 14:02:50,216 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1/46991fbc73244343a3f208783672d679, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 14:02:50,217 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2/7bd9b6fcddaa4358a014d76e83a1222d, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 14:02:50,217 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/.tmp/f2/ca8f6eeaeeba4b18a9ba2584afc4ee36 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2/ca8f6eeaeeba4b18a9ba2584afc4ee36 2023-02-07 14:02:50,218 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e9a23cbdeed13f0100ce5ce7445e651a in 158ms, sequenceid=9, compaction requested=false 2023-02-07 14:02:50,218 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e9a23cbdeed13f0100ce5ce7445e651a: 2023-02-07 14:02:50,218 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:50,218 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:50,218 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 14:02:50,218 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. started... 2023-02-07 14:02:50,218 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8691d855b35ad124573f3d9aa7a6c525 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:02:50,225 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2/ca8f6eeaeeba4b18a9ba2584afc4ee36, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 14:02:50,226 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 6816d8c175af9806ef749579bd93cbf3 in 161ms, sequenceid=9, compaction requested=false 2023-02-07 14:02:50,226 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6816d8c175af9806ef749579bd93cbf3: 2023-02-07 14:02:50,226 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:50,226 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 14:02:50,239 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/.tmp/f1/f2d3d62d14104b4d84656807ab9ae794 2023-02-07 14:02:50,242 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/.tmp/f1/d4f0f457836c474983d8874e2aabe850 2023-02-07 14:02:50,258 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/.tmp/f2/a0dfb9c82e7441b18a2dd88a7a2a06f6 2023-02-07 14:02:50,260 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/.tmp/f2/5bccbda8f0e348858909192b1ad48304 2023-02-07 14:02:50,265 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/.tmp/f1/f2d3d62d14104b4d84656807ab9ae794 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1/f2d3d62d14104b4d84656807ab9ae794 2023-02-07 14:02:50,267 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/.tmp/f1/d4f0f457836c474983d8874e2aabe850 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1/d4f0f457836c474983d8874e2aabe850 2023-02-07 14:02:50,271 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1/f2d3d62d14104b4d84656807ab9ae794, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:02:50,272 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/.tmp/f2/a0dfb9c82e7441b18a2dd88a7a2a06f6 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2/a0dfb9c82e7441b18a2dd88a7a2a06f6 2023-02-07 14:02:50,273 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1/d4f0f457836c474983d8874e2aabe850, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:02:50,274 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/.tmp/f2/5bccbda8f0e348858909192b1ad48304 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2/5bccbda8f0e348858909192b1ad48304 2023-02-07 14:02:50,279 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2/a0dfb9c82e7441b18a2dd88a7a2a06f6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:02:50,280 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3e8eb2655570dcc33e6f1d2553004acf in 68ms, sequenceid=9, compaction requested=false 2023-02-07 14:02:50,280 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 3e8eb2655570dcc33e6f1d2553004acf: 2023-02-07 14:02:50,280 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:50,280 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2/5bccbda8f0e348858909192b1ad48304, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:02:50,280 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 14:02:50,281 INFO [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8691d855b35ad124573f3d9aa7a6c525 in 63ms, sequenceid=9, compaction requested=false 2023-02-07 14:02:50,281 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8691d855b35ad124573f3d9aa7a6c525: 2023-02-07 14:02:50,281 DEBUG [rs(jenkins-hbase4.apache.org,35817,1675778562952)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:50,281 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 14:02:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 14:02:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 14:02:50,282 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35817,1675778562952' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 14:02:50,284 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:02:50,284 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:02:50,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:02:50,285 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:02:50,285 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:02:50,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:02:50,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:02:50,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:02:50,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:02:50,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35817,1675778562952' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 14:02:50,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76d79823[Count = 1] remaining members to acquire global barrier 2023-02-07 14:02:50,338 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 14:02:50,407 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-07 14:02:50,409 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-07 14:02:50,530 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/.tmp/f1/5cca269bdfaf4e96ae0f0b1b856e7ba3 2023-02-07 14:02:50,548 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/.tmp/f2/3f0d242871b34ea794aac28a80d91f07 2023-02-07 14:02:50,554 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/.tmp/f1/5cca269bdfaf4e96ae0f0b1b856e7ba3 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1/5cca269bdfaf4e96ae0f0b1b856e7ba3 2023-02-07 14:02:50,558 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/.tmp/f1/ea11994f28c244ca8eea4adabb3a10be 2023-02-07 14:02:50,565 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1/5cca269bdfaf4e96ae0f0b1b856e7ba3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:02:50,566 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/.tmp/f2/3f0d242871b34ea794aac28a80d91f07 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2/3f0d242871b34ea794aac28a80d91f07 2023-02-07 14:02:50,572 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2/3f0d242871b34ea794aac28a80d91f07, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:02:50,573 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 45af8e26bbb35d3c7fbeb12766ba1e5c in 510ms, sequenceid=9, compaction requested=false 2023-02-07 14:02:50,574 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 45af8e26bbb35d3c7fbeb12766ba1e5c: 2023-02-07 14:02:50,574 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:50,574 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 14:02:50,580 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/.tmp/f2/a0411187c88f43c0a62ee80ab84d1ed0 2023-02-07 14:02:50,587 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/.tmp/f1/ea11994f28c244ca8eea4adabb3a10be as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1/ea11994f28c244ca8eea4adabb3a10be 2023-02-07 14:02:50,593 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1/ea11994f28c244ca8eea4adabb3a10be, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:02:50,594 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/.tmp/f2/a0411187c88f43c0a62ee80ab84d1ed0 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2/a0411187c88f43c0a62ee80ab84d1ed0 2023-02-07 14:02:50,599 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2/a0411187c88f43c0a62ee80ab84d1ed0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:02:50,600 INFO [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b3da998557027663b1b762e486d589c3 in 538ms, sequenceid=9, compaction requested=false 2023-02-07 14:02:50,601 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b3da998557027663b1b762e486d589c3: 2023-02-07 14:02:50,601 DEBUG [rs(jenkins-hbase4.apache.org,42681,1675778562998)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:50,601 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 14:02:50,601 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 14:02:50,601 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,601 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 14:02:50,601 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42681,1675778562998' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 14:02:50,603 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:02:50,603 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:02:50,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:02:50,603 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:02:50,603 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:02:50,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:02:50,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:02:50,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:02:50,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:02:50,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42681,1675778562998' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 14:02:50,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76d79823[Count = 0] remaining members to acquire global barrier 2023-02-07 14:02:50,605 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-07 14:02:50,606 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:02:50,608 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:02:50,608 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:02:50,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:02:50,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:02:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:02:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:02:50,609 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 14:02:50,609 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 14:02:50,609 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 14:02:50,609 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 14:02:50,609 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42681,1675778562998' in zk 2023-02-07 14:02:50,609 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35817,1675778562952' in zk 2023-02-07 14:02:50,609 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,609 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,609 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:02:50,611 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 14:02:50,611 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 14:02:50,611 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,611 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:02:50,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:02:50,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:02:50,611 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,611 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:02:50,611 DEBUG [member: 'jenkins-hbase4.apache.org,42681,1675778562998' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 14:02:50,612 DEBUG [member: 'jenkins-hbase4.apache.org,35817,1675778562952' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 14:02:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:02:50,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:02:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:02:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:02:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:02:50,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,42681,1675778562998': 2023-02-07 14:02:50,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42681,1675778562998' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-07 14:02:50,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:02:50,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:02:50,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:02:50,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:02:50,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:02:50,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:02:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:02:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35817,1675778562952': 2023-02-07 14:02:50,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35817,1675778562952' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-07 14:02:50,622 INFO [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-07 14:02:50,622 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:02:50,622 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:02:50,622 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-07 14:02:50,623 INFO [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 14:02:50,625 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,625 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:02:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:02:50,625 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:02:50,625 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,625 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:02:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:02:50,625 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:02:50,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:02:50,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:02:50,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:02:50,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:02:50,626 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:02:50,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:02:50,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:02:50,628 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:02:50,629 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,635 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:02:50,635 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:02:50,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:02:50,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:02:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:02:50,635 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:02:50,635 DEBUG [(jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:02:50,635 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:02:50,635 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-07 14:02:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:02:50,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:02:50,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:02:50,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 14:02:50,636 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:02:50,636 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,636 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:02:50,636 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:50,636 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:02:50,636 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:50,636 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:02:50,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:02:50,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:02:50,636 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:02:50,638 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-07 14:02:50,638 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 14:02:50,738 DEBUG [Listener at localhost/40837] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 14:02:50,739 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:50,739 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:50,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 14:02:50,851 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/hadoop-1508993590681917457.jar 2023-02-07 14:02:50,867 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675778567600 type: FLUSH version: 2 ttl: 0 2023-02-07 14:02:50,868 DEBUG [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce 2023-02-07 14:02:50,869 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(239): region to add: e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:50,869 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(239): region to add: 4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:50,869 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(239): region to add: 74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:50,869 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(239): region to add: e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:50,869 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(239): region to add: 02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:50,869 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(239): region to add: 6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:50,870 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(239): region to add: 3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:50,870 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(239): region to add: b3da998557027663b1b762e486d589c3 2023-02-07 14:02:50,870 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(239): region to add: 8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:50,870 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(239): region to add: 45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:50,870 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(585): clone region=e9a23cbdeed13f0100ce5ce7445e651a as e9a23cbdeed13f0100ce5ce7445e651a in snapshot testWithMapReduceMultiRegion 2023-02-07 14:02:50,870 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(585): clone region=4e403e3da79dd6bdefdf65e3b57bcd6f as 4e403e3da79dd6bdefdf65e3b57bcd6f in snapshot testWithMapReduceMultiRegion 2023-02-07 14:02:50,870 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(585): clone region=74a6ba96b740e3fd09a268bcd8453427 as 74a6ba96b740e3fd09a268bcd8453427 in snapshot testWithMapReduceMultiRegion 2023-02-07 14:02:50,870 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(585): clone region=e1cdf44635ff1b97044d6263fbaa981a as e1cdf44635ff1b97044d6263fbaa981a in snapshot testWithMapReduceMultiRegion 2023-02-07 14:02:50,870 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(585): clone region=02dbd90de942d8345117748d1abdcdd3 as 02dbd90de942d8345117748d1abdcdd3 in snapshot testWithMapReduceMultiRegion 2023-02-07 14:02:50,870 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(585): clone region=6816d8c175af9806ef749579bd93cbf3 as 6816d8c175af9806ef749579bd93cbf3 in snapshot testWithMapReduceMultiRegion 2023-02-07 14:02:50,870 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(585): clone region=3e8eb2655570dcc33e6f1d2553004acf as 3e8eb2655570dcc33e6f1d2553004acf in snapshot testWithMapReduceMultiRegion 2023-02-07 14:02:50,870 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(585): clone region=b3da998557027663b1b762e486d589c3 as b3da998557027663b1b762e486d589c3 in snapshot testWithMapReduceMultiRegion 2023-02-07 14:02:50,870 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(585): clone region=8691d855b35ad124573f3d9aa7a6c525 as 8691d855b35ad124573f3d9aa7a6c525 in snapshot testWithMapReduceMultiRegion 2023-02-07 14:02:50,871 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(585): clone region=45af8e26bbb35d3c7fbeb12766ba1e5c as 45af8e26bbb35d3c7fbeb12766ba1e5c in snapshot testWithMapReduceMultiRegion 2023-02-07 14:02:50,874 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 6816d8c175af9806ef749579bd93cbf3, NAME => 'testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f 2023-02-07 14:02:50,874 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 02dbd90de942d8345117748d1abdcdd3, NAME => 'testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f 2023-02-07 14:02:50,874 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 74a6ba96b740e3fd09a268bcd8453427, NAME => 'testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f 2023-02-07 14:02:50,875 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4e403e3da79dd6bdefdf65e3b57bcd6f, NAME => 'testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f 2023-02-07 14:02:50,875 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 3e8eb2655570dcc33e6f1d2553004acf, NAME => 'testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f 2023-02-07 14:02:50,875 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => e1cdf44635ff1b97044d6263fbaa981a, NAME => 'testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f 2023-02-07 14:02:50,875 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e9a23cbdeed13f0100ce5ce7445e651a, NAME => 'testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f 2023-02-07 14:02:50,875 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => b3da998557027663b1b762e486d589c3, NAME => 'testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f 2023-02-07 14:02:50,899 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:50,899 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 905021f88ab14c8e8d221abf34af39b7 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,904 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:50,904 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a26c28bb5f134693961d1d3e93909d2d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,906 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 328c20d1d3004e378680c989083bf634 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,909 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:50,909 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 78221aa9e37e459e8fe449828051c4aa from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,914 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:50,914 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1151a8a727424ea69ea0047302a18f1d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,920 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8cf0d0575a3b4c9c8a22d0f657314094 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,921 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:50,921 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing e1cdf44635ff1b97044d6263fbaa981a, disabling compactions & flushes 2023-02-07 14:02:50,921 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 10f1ba8634e9436a924737c32cad653d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,921 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:50,921 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:50,921 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. after waiting 0 ms 2023-02-07 14:02:50,921 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:50,921 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:50,921 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3afb7cb49ca144c396b1aec27d1f35f9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,921 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for e1cdf44635ff1b97044d6263fbaa981a: Waiting for close lock at 1675778570921Disabling compacts and flushes for region at 1675778570921Disabling writes for close at 1675778570921Writing region close event to WAL at 1675778570921Closed at 1675778570921 2023-02-07 14:02:50,922 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 8691d855b35ad124573f3d9aa7a6c525, NAME => 'testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f 2023-02-07 14:02:50,931 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:50,932 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 4e403e3da79dd6bdefdf65e3b57bcd6f, disabling compactions & flushes 2023-02-07 14:02:50,932 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:50,932 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:50,932 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. after waiting 0 ms 2023-02-07 14:02:50,932 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:50,932 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:50,932 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 4e403e3da79dd6bdefdf65e3b57bcd6f: Waiting for close lock at 1675778570932Disabling compacts and flushes for region at 1675778570932Disabling writes for close at 1675778570932Writing region close event to WAL at 1675778570932Closed at 1675778570932 2023-02-07 14:02:50,932 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 00d674550f3c4a8eb3430697a3c0e9e0 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,933 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 45af8e26bbb35d3c7fbeb12766ba1e5c, NAME => 'testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f 2023-02-07 14:02:50,936 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 802a3a2619df4efbba1e338f1df0abc4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,936 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:50,936 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 02dbd90de942d8345117748d1abdcdd3, disabling compactions & flushes 2023-02-07 14:02:50,937 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:50,937 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:50,937 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. after waiting 0 ms 2023-02-07 14:02:50,937 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:50,937 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:50,937 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 02dbd90de942d8345117748d1abdcdd3: Waiting for close lock at 1675778570936Disabling compacts and flushes for region at 1675778570936Disabling writes for close at 1675778570937 (+1 ms)Writing region close event to WAL at 1675778570937Closed at 1675778570937 2023-02-07 14:02:50,941 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 3e8eb2655570dcc33e6f1d2553004acf, disabling compactions & flushes 2023-02-07 14:02:50,941 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:50,941 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:50,941 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. after waiting 0 ms 2023-02-07 14:02:50,941 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:50,941 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:50,941 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 3e8eb2655570dcc33e6f1d2553004acf: Waiting for close lock at 1675778570941Disabling compacts and flushes for region at 1675778570941Disabling writes for close at 1675778570941Writing region close event to WAL at 1675778570941Closed at 1675778570941 2023-02-07 14:02:50,941 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e9a23cbdeed13f0100ce5ce7445e651a, disabling compactions & flushes 2023-02-07 14:02:50,941 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:50,942 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:50,942 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. after waiting 0 ms 2023-02-07 14:02:50,942 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:50,942 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:50,942 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e9a23cbdeed13f0100ce5ce7445e651a: Waiting for close lock at 1675778570941Disabling compacts and flushes for region at 1675778570941Disabling writes for close at 1675778570942 (+1 ms)Writing region close event to WAL at 1675778570942Closed at 1675778570942 2023-02-07 14:02:50,944 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 6816d8c175af9806ef749579bd93cbf3, disabling compactions & flushes 2023-02-07 14:02:50,944 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:50,944 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:50,944 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. after waiting 0 ms 2023-02-07 14:02:50,944 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:50,944 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:50,944 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 6816d8c175af9806ef749579bd93cbf3: Waiting for close lock at 1675778570944Disabling compacts and flushes for region at 1675778570944Disabling writes for close at 1675778570944Writing region close event to WAL at 1675778570944Closed at 1675778570944 2023-02-07 14:02:50,945 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing b3da998557027663b1b762e486d589c3, disabling compactions & flushes 2023-02-07 14:02:50,945 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:50,945 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:50,945 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. after waiting 0 ms 2023-02-07 14:02:50,945 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:50,945 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:50,946 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for b3da998557027663b1b762e486d589c3: Waiting for close lock at 1675778570945Disabling compacts and flushes for region at 1675778570945Disabling writes for close at 1675778570945Writing region close event to WAL at 1675778570945Closed at 1675778570945 2023-02-07 14:02:50,952 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:50,952 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a3dcbaa429e1465f9d07fadad231ce54 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,953 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:50,953 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4144f0ea70484a79b7f4f9e2e3ca89d7 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,955 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 21ef149e36644b81bac544390e1b44a3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,956 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dd5a6d74a24444888657308b54817c11 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:50,957 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 8691d855b35ad124573f3d9aa7a6c525, disabling compactions & flushes 2023-02-07 14:02:50,958 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:50,958 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:50,958 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. after waiting 0 ms 2023-02-07 14:02:50,958 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:50,958 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:50,958 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 8691d855b35ad124573f3d9aa7a6c525: Waiting for close lock at 1675778570957Disabling compacts and flushes for region at 1675778570957Disabling writes for close at 1675778570958 (+1 ms)Writing region close event to WAL at 1675778570958Closed at 1675778570958 2023-02-07 14:02:50,958 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 45af8e26bbb35d3c7fbeb12766ba1e5c, disabling compactions & flushes 2023-02-07 14:02:50,958 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:50,959 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:50,959 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. after waiting 0 ms 2023-02-07 14:02:50,959 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:50,959 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:50,959 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 45af8e26bbb35d3c7fbeb12766ba1e5c: Waiting for close lock at 1675778570958Disabling compacts and flushes for region at 1675778570958Disabling writes for close at 1675778570959 (+1 ms)Writing region close event to WAL at 1675778570959Closed at 1675778570959 2023-02-07 14:02:51,341 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:51,342 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d21ce6d709b74791a5a3f9b6a4c29180 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:51,345 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6ea6c77ef27e489eb839537e38e8c93d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-07 14:02:51,347 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 74a6ba96b740e3fd09a268bcd8453427, disabling compactions & flushes 2023-02-07 14:02:51,347 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:51,348 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:51,348 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. after waiting 0 ms 2023-02-07 14:02:51,348 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:51,348 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:51,348 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 74a6ba96b740e3fd09a268bcd8453427: Waiting for close lock at 1675778571347Disabling compacts and flushes for region at 1675778571347Disabling writes for close at 1675778571348 (+1 ms)Writing region close event to WAL at 1675778571348Closed at 1675778571348 2023-02-07 14:02:51,348 INFO [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1675778567600 type: FLUSH version: 2 ttl: 0 2023-02-07 14:02:51,348 DEBUG [Listener at localhost/40837] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f 2023-02-07 14:02:51,348 DEBUG [Listener at localhost/40837] util.CommonFSUtils(682): File system contents for path hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f 2023-02-07 14:02:51,349 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-data/ 2023-02-07 14:02:51,350 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |----default/ 2023-02-07 14:02:51,350 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-07 14:02:51,351 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |----------02dbd90de942d8345117748d1abdcdd3/ 2023-02-07 14:02:51,352 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:02:51,352 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |----------3e8eb2655570dcc33e6f1d2553004acf/ 2023-02-07 14:02:51,352 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:02:51,353 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:02:51,353 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=3e8eb2655570dcc33e6f1d2553004acf-78221aa9e37e459e8fe449828051c4aa 2023-02-07 14:02:51,353 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:02:51,354 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=3e8eb2655570dcc33e6f1d2553004acf-8cf0d0575a3b4c9c8a22d0f657314094 2023-02-07 14:02:51,354 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |----------45af8e26bbb35d3c7fbeb12766ba1e5c/ 2023-02-07 14:02:51,354 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:02:51,355 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:02:51,355 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=45af8e26bbb35d3c7fbeb12766ba1e5c-4144f0ea70484a79b7f4f9e2e3ca89d7 2023-02-07 14:02:51,355 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:02:51,356 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=45af8e26bbb35d3c7fbeb12766ba1e5c-dd5a6d74a24444888657308b54817c11 2023-02-07 14:02:51,356 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |----------4e403e3da79dd6bdefdf65e3b57bcd6f/ 2023-02-07 14:02:51,356 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:02:51,357 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |----------6816d8c175af9806ef749579bd93cbf3/ 2023-02-07 14:02:51,357 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:02:51,357 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:02:51,358 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=6816d8c175af9806ef749579bd93cbf3-1151a8a727424ea69ea0047302a18f1d 2023-02-07 14:02:51,358 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:02:51,358 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=6816d8c175af9806ef749579bd93cbf3-00d674550f3c4a8eb3430697a3c0e9e0 2023-02-07 14:02:51,359 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |----------74a6ba96b740e3fd09a268bcd8453427/ 2023-02-07 14:02:51,359 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:02:51,359 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:02:51,360 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=74a6ba96b740e3fd09a268bcd8453427-d21ce6d709b74791a5a3f9b6a4c29180 2023-02-07 14:02:51,360 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:02:51,361 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=74a6ba96b740e3fd09a268bcd8453427-6ea6c77ef27e489eb839537e38e8c93d 2023-02-07 14:02:51,361 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |----------8691d855b35ad124573f3d9aa7a6c525/ 2023-02-07 14:02:51,361 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:02:51,361 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:02:51,362 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=8691d855b35ad124573f3d9aa7a6c525-a3dcbaa429e1465f9d07fadad231ce54 2023-02-07 14:02:51,362 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:02:51,363 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=8691d855b35ad124573f3d9aa7a6c525-21ef149e36644b81bac544390e1b44a3 2023-02-07 14:02:51,363 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |----------b3da998557027663b1b762e486d589c3/ 2023-02-07 14:02:51,363 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:02:51,363 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:02:51,364 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=b3da998557027663b1b762e486d589c3-10f1ba8634e9436a924737c32cad653d 2023-02-07 14:02:51,364 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:02:51,364 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=b3da998557027663b1b762e486d589c3-802a3a2619df4efbba1e338f1df0abc4 2023-02-07 14:02:51,365 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |----------e1cdf44635ff1b97044d6263fbaa981a/ 2023-02-07 14:02:51,365 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:02:51,365 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:02:51,366 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=e1cdf44635ff1b97044d6263fbaa981a-905021f88ab14c8e8d221abf34af39b7 2023-02-07 14:02:51,366 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:02:51,366 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=e1cdf44635ff1b97044d6263fbaa981a-328c20d1d3004e378680c989083bf634 2023-02-07 14:02:51,366 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |----------e9a23cbdeed13f0100ce5ce7445e651a/ 2023-02-07 14:02:51,367 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:02:51,367 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:02:51,367 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=e9a23cbdeed13f0100ce5ce7445e651a-a26c28bb5f134693961d1d3e93909d2d 2023-02-07 14:02:51,367 DEBUG [Listener at localhost/40837] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:02:51,368 DEBUG [Listener at localhost/40837] util.CommonFSUtils(702): |----------------testWithMapReduce=e9a23cbdeed13f0100ce5ce7445e651a-3afb7cb49ca144c396b1aec27d1f35f9 2023-02-07 14:02:51,376 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 14:02:51,377 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-07 14:02:51,377 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-07 14:02:51,378 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-07 14:02:51,904 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 14:02:51,905 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-07 14:02:52,276 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/hadoop-7881183164161453817.jar 2023-02-07 14:02:52,277 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-07 14:02:52,278 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-07 14:02:52,353 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/hadoop-6576201046604104771.jar 2023-02-07 14:02:52,354 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-07 14:02:52,354 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-07 14:02:52,355 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-07 14:02:52,355 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-07 14:02:52,356 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-07 14:02:52,356 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-07 14:02:52,357 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-07 14:02:52,357 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-07 14:02:52,358 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-07 14:02:52,358 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-07 14:02:52,359 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-07 14:02:52,359 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-07 14:02:52,360 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-07 14:02:52,360 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-07 14:02:52,361 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-07 14:02:52,361 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-07 14:02:52,367 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 14:02:52,368 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 14:02:52,369 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 14:02:52,369 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 14:02:52,369 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 14:02:52,443 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/hadoop-5736452072453883650.jar 2023-02-07 14:02:52,444 DEBUG [Listener at localhost/40837] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 14:02:52,501 WARN [Listener at localhost/40837] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-07 14:02:52,513 WARN [Listener at localhost/40837] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-07 14:02:52,525 INFO [Listener at localhost/40837] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 14:02:52,984 WARN [Listener at localhost/40837] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/mapreduce.cluster.local.dir/1675778572875/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-07 14:02:52,984 WARN [Listener at localhost/40837] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/mapreduce.cluster.local.dir/1675778572875/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-07 14:02:53,171 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:53,171 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:02:53,173 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:53,175 INFO [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:53,177 DEBUG [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3/f1 2023-02-07 14:02:53,177 INFO [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02dbd90de942d8345117748d1abdcdd3 columnFamilyName f1 2023-02-07 14:02:53,178 INFO [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] regionserver.HStore(310): Store=02dbd90de942d8345117748d1abdcdd3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,178 INFO [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:53,180 DEBUG [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3/f2 2023-02-07 14:02:53,181 INFO [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02dbd90de942d8345117748d1abdcdd3 columnFamilyName f2 2023-02-07 14:02:53,181 INFO [StoreOpener-02dbd90de942d8345117748d1abdcdd3-1] regionserver.HStore(310): Store=02dbd90de942d8345117748d1abdcdd3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,182 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:53,182 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 02dbd90de942d8345117748d1abdcdd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70028187, jitterRate=0.04350130259990692}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:53,182 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 02dbd90de942d8345117748d1abdcdd3: Writing region info on filesystem at 1675778573173Initializing all the Stores at 1675778573174 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573174Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573174Region opened successfully at 1675778573182 (+8 ms) 2023-02-07 14:02:53,280 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 02dbd90de942d8345117748d1abdcdd3, disabling compactions & flushes 2023-02-07 14:02:53,280 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:53,280 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:53,280 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. after waiting 0 ms 2023-02-07 14:02:53,280 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:53,280 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:53,281 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 02dbd90de942d8345117748d1abdcdd3: Waiting for close lock at 1675778573280Disabling compacts and flushes for region at 1675778573280Disabling writes for close at 1675778573280Writing region close event to WAL at 1675778573280Closed at 1675778573280 2023-02-07 14:02:53,297 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:53,297 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:02:53,298 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:53,300 INFO [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:53,301 DEBUG [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1 2023-02-07 14:02:53,301 INFO [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e8eb2655570dcc33e6f1d2553004acf columnFamilyName f1 2023-02-07 14:02:53,310 DEBUG [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1/testWithMapReduce=3e8eb2655570dcc33e6f1d2553004acf-78221aa9e37e459e8fe449828051c4aa 2023-02-07 14:02:53,311 INFO [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] regionserver.HStore(310): Store=3e8eb2655570dcc33e6f1d2553004acf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,311 INFO [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:53,312 DEBUG [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2 2023-02-07 14:02:53,312 INFO [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e8eb2655570dcc33e6f1d2553004acf columnFamilyName f2 2023-02-07 14:02:53,318 DEBUG [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2/testWithMapReduce=3e8eb2655570dcc33e6f1d2553004acf-8cf0d0575a3b4c9c8a22d0f657314094 2023-02-07 14:02:53,318 INFO [StoreOpener-3e8eb2655570dcc33e6f1d2553004acf-1] regionserver.HStore(310): Store=3e8eb2655570dcc33e6f1d2553004acf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,319 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:53,319 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3e8eb2655570dcc33e6f1d2553004acf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62552861, jitterRate=-0.0678897351026535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:53,319 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3e8eb2655570dcc33e6f1d2553004acf: Writing region info on filesystem at 1675778573298Initializing all the Stores at 1675778573299 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573299Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573299Region opened successfully at 1675778573319 (+20 ms) 2023-02-07 14:02:53,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3e8eb2655570dcc33e6f1d2553004acf, disabling compactions & flushes 2023-02-07 14:02:53,446 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:53,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:53,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. after waiting 0 ms 2023-02-07 14:02:53,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:53,491 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:53,491 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3e8eb2655570dcc33e6f1d2553004acf: Waiting for close lock at 1675778573446Disabling compacts and flushes for region at 1675778573446Disabling writes for close at 1675778573446Writing region close event to WAL at 1675778573491 (+45 ms)Closed at 1675778573491 2023-02-07 14:02:53,497 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:53,497 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:02:53,500 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:53,504 INFO [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:53,506 DEBUG [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1 2023-02-07 14:02:53,506 INFO [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45af8e26bbb35d3c7fbeb12766ba1e5c columnFamilyName f1 2023-02-07 14:02:53,514 DEBUG [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1/testWithMapReduce=45af8e26bbb35d3c7fbeb12766ba1e5c-4144f0ea70484a79b7f4f9e2e3ca89d7 2023-02-07 14:02:53,514 INFO [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] regionserver.HStore(310): Store=45af8e26bbb35d3c7fbeb12766ba1e5c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,515 INFO [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:53,516 DEBUG [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2 2023-02-07 14:02:53,517 INFO [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45af8e26bbb35d3c7fbeb12766ba1e5c columnFamilyName f2 2023-02-07 14:02:53,525 DEBUG [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2/testWithMapReduce=45af8e26bbb35d3c7fbeb12766ba1e5c-dd5a6d74a24444888657308b54817c11 2023-02-07 14:02:53,525 INFO [StoreOpener-45af8e26bbb35d3c7fbeb12766ba1e5c-1] regionserver.HStore(310): Store=45af8e26bbb35d3c7fbeb12766ba1e5c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:53,526 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 45af8e26bbb35d3c7fbeb12766ba1e5c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67642773, jitterRate=0.007955864071846008}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:53,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 45af8e26bbb35d3c7fbeb12766ba1e5c: Writing region info on filesystem at 1675778573500Initializing all the Stores at 1675778573501 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573501Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573504 (+3 ms)Region opened successfully at 1675778573526 (+22 ms) 2023-02-07 14:02:53,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 45af8e26bbb35d3c7fbeb12766ba1e5c, disabling compactions & flushes 2023-02-07 14:02:53,579 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:53,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:53,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. after waiting 0 ms 2023-02-07 14:02:53,579 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:53,583 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:53,583 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 45af8e26bbb35d3c7fbeb12766ba1e5c: Waiting for close lock at 1675778573579Disabling compacts and flushes for region at 1675778573579Disabling writes for close at 1675778573579Writing region close event to WAL at 1675778573583 (+4 ms)Closed at 1675778573583 2023-02-07 14:02:53,588 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:53,588 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:02:53,601 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:53,603 INFO [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:53,605 DEBUG [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f/f1 2023-02-07 14:02:53,605 INFO [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e403e3da79dd6bdefdf65e3b57bcd6f columnFamilyName f1 2023-02-07 14:02:53,606 INFO [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] regionserver.HStore(310): Store=4e403e3da79dd6bdefdf65e3b57bcd6f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,606 INFO [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:53,608 DEBUG [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f/f2 2023-02-07 14:02:53,609 INFO [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e403e3da79dd6bdefdf65e3b57bcd6f columnFamilyName f2 2023-02-07 14:02:53,609 INFO [StoreOpener-4e403e3da79dd6bdefdf65e3b57bcd6f-1] regionserver.HStore(310): Store=4e403e3da79dd6bdefdf65e3b57bcd6f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,610 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:53,610 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4e403e3da79dd6bdefdf65e3b57bcd6f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67249384, jitterRate=0.0020939111709594727}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:53,610 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4e403e3da79dd6bdefdf65e3b57bcd6f: Writing region info on filesystem at 1675778573601Initializing all the Stores at 1675778573602 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573602Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573602Region opened successfully at 1675778573610 (+8 ms) 2023-02-07 14:02:53,628 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4e403e3da79dd6bdefdf65e3b57bcd6f, disabling compactions & flushes 2023-02-07 14:02:53,629 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:53,629 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:53,629 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. after waiting 0 ms 2023-02-07 14:02:53,629 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:53,629 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:53,629 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4e403e3da79dd6bdefdf65e3b57bcd6f: Waiting for close lock at 1675778573628Disabling compacts and flushes for region at 1675778573628Disabling writes for close at 1675778573629 (+1 ms)Writing region close event to WAL at 1675778573629Closed at 1675778573629 2023-02-07 14:02:53,634 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:53,634 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:02:53,635 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:53,637 INFO [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:53,638 DEBUG [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1 2023-02-07 14:02:53,639 INFO [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8691d855b35ad124573f3d9aa7a6c525 columnFamilyName f1 2023-02-07 14:02:53,651 DEBUG [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1/testWithMapReduce=8691d855b35ad124573f3d9aa7a6c525-a3dcbaa429e1465f9d07fadad231ce54 2023-02-07 14:02:53,651 INFO [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] regionserver.HStore(310): Store=8691d855b35ad124573f3d9aa7a6c525/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,651 INFO [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:53,652 DEBUG [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2 2023-02-07 14:02:53,653 INFO [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8691d855b35ad124573f3d9aa7a6c525 columnFamilyName f2 2023-02-07 14:02:53,659 DEBUG [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2/testWithMapReduce=8691d855b35ad124573f3d9aa7a6c525-21ef149e36644b81bac544390e1b44a3 2023-02-07 14:02:53,659 INFO [StoreOpener-8691d855b35ad124573f3d9aa7a6c525-1] regionserver.HStore(310): Store=8691d855b35ad124573f3d9aa7a6c525/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,659 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:53,659 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8691d855b35ad124573f3d9aa7a6c525; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64350554, jitterRate=-0.04110202193260193}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:53,659 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8691d855b35ad124573f3d9aa7a6c525: Writing region info on filesystem at 1675778573635Initializing all the Stores at 1675778573636 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573636Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573637 (+1 ms)Region opened successfully at 1675778573659 (+22 ms) 2023-02-07 14:02:53,710 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8691d855b35ad124573f3d9aa7a6c525, disabling compactions & flushes 2023-02-07 14:02:53,711 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:53,711 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:53,711 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. after waiting 0 ms 2023-02-07 14:02:53,711 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:53,714 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:53,715 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8691d855b35ad124573f3d9aa7a6c525: Waiting for close lock at 1675778573710Disabling compacts and flushes for region at 1675778573710Disabling writes for close at 1675778573711 (+1 ms)Writing region close event to WAL at 1675778573714 (+3 ms)Closed at 1675778573714 2023-02-07 14:02:53,722 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:53,722 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:02:53,728 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:53,741 INFO [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:53,742 DEBUG [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1 2023-02-07 14:02:53,743 INFO [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74a6ba96b740e3fd09a268bcd8453427 columnFamilyName f1 2023-02-07 14:02:53,752 DEBUG [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1/testWithMapReduce=74a6ba96b740e3fd09a268bcd8453427-d21ce6d709b74791a5a3f9b6a4c29180 2023-02-07 14:02:53,752 INFO [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] regionserver.HStore(310): Store=74a6ba96b740e3fd09a268bcd8453427/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,752 INFO [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:53,753 DEBUG [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2 2023-02-07 14:02:53,754 INFO [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74a6ba96b740e3fd09a268bcd8453427 columnFamilyName f2 2023-02-07 14:02:53,760 DEBUG [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2/testWithMapReduce=74a6ba96b740e3fd09a268bcd8453427-6ea6c77ef27e489eb839537e38e8c93d 2023-02-07 14:02:53,760 INFO [StoreOpener-74a6ba96b740e3fd09a268bcd8453427-1] regionserver.HStore(310): Store=74a6ba96b740e3fd09a268bcd8453427/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,760 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:53,761 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 74a6ba96b740e3fd09a268bcd8453427; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69930750, jitterRate=0.04204937815666199}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:53,761 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 74a6ba96b740e3fd09a268bcd8453427: Writing region info on filesystem at 1675778573728Initializing all the Stores at 1675778573740 (+12 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573740Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573740Region opened successfully at 1675778573761 (+21 ms) 2023-02-07 14:02:53,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 74a6ba96b740e3fd09a268bcd8453427, disabling compactions & flushes 2023-02-07 14:02:53,816 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:53,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:53,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. after waiting 0 ms 2023-02-07 14:02:53,816 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:53,837 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:53,837 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 74a6ba96b740e3fd09a268bcd8453427: Waiting for close lock at 1675778573816Disabling compacts and flushes for region at 1675778573816Disabling writes for close at 1675778573816Writing region close event to WAL at 1675778573837 (+21 ms)Closed at 1675778573837 2023-02-07 14:02:53,846 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:53,846 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:02:53,860 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:53,862 INFO [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:53,864 DEBUG [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1 2023-02-07 14:02:53,864 INFO [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6816d8c175af9806ef749579bd93cbf3 columnFamilyName f1 2023-02-07 14:02:53,872 DEBUG [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1/testWithMapReduce=6816d8c175af9806ef749579bd93cbf3-1151a8a727424ea69ea0047302a18f1d 2023-02-07 14:02:53,872 INFO [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] regionserver.HStore(310): Store=6816d8c175af9806ef749579bd93cbf3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,872 INFO [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:53,873 DEBUG [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2 2023-02-07 14:02:53,874 INFO [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6816d8c175af9806ef749579bd93cbf3 columnFamilyName f2 2023-02-07 14:02:53,879 DEBUG [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2/testWithMapReduce=6816d8c175af9806ef749579bd93cbf3-00d674550f3c4a8eb3430697a3c0e9e0 2023-02-07 14:02:53,880 INFO [StoreOpener-6816d8c175af9806ef749579bd93cbf3-1] regionserver.HStore(310): Store=6816d8c175af9806ef749579bd93cbf3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,880 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:53,880 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 6816d8c175af9806ef749579bd93cbf3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63092421, jitterRate=-0.05984966456890106}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:53,880 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 6816d8c175af9806ef749579bd93cbf3: Writing region info on filesystem at 1675778573860Initializing all the Stores at 1675778573861 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573861Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573861Region opened successfully at 1675778573880 (+19 ms) 2023-02-07 14:02:53,923 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 6816d8c175af9806ef749579bd93cbf3, disabling compactions & flushes 2023-02-07 14:02:53,924 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:53,924 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:53,924 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. after waiting 0 ms 2023-02-07 14:02:53,924 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:53,942 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:53,943 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 6816d8c175af9806ef749579bd93cbf3: Waiting for close lock at 1675778573923Disabling compacts and flushes for region at 1675778573923Disabling writes for close at 1675778573924 (+1 ms)Writing region close event to WAL at 1675778573942 (+18 ms)Closed at 1675778573942 2023-02-07 14:02:53,958 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:53,958 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:02:53,967 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:53,970 INFO [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:53,971 DEBUG [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1 2023-02-07 14:02:53,972 INFO [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9a23cbdeed13f0100ce5ce7445e651a columnFamilyName f1 2023-02-07 14:02:53,985 DEBUG [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1/testWithMapReduce=e9a23cbdeed13f0100ce5ce7445e651a-a26c28bb5f134693961d1d3e93909d2d 2023-02-07 14:02:53,986 INFO [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] regionserver.HStore(310): Store=e9a23cbdeed13f0100ce5ce7445e651a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,986 INFO [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:53,987 DEBUG [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2 2023-02-07 14:02:53,987 INFO [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9a23cbdeed13f0100ce5ce7445e651a columnFamilyName f2 2023-02-07 14:02:53,994 DEBUG [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2/testWithMapReduce=e9a23cbdeed13f0100ce5ce7445e651a-3afb7cb49ca144c396b1aec27d1f35f9 2023-02-07 14:02:53,994 INFO [StoreOpener-e9a23cbdeed13f0100ce5ce7445e651a-1] regionserver.HStore(310): Store=e9a23cbdeed13f0100ce5ce7445e651a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:53,995 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:53,995 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e9a23cbdeed13f0100ce5ce7445e651a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73976171, jitterRate=0.10233084857463837}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:53,995 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e9a23cbdeed13f0100ce5ce7445e651a: Writing region info on filesystem at 1675778573967Initializing all the Stores at 1675778573969 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573969Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778573969Region opened successfully at 1675778573995 (+26 ms) 2023-02-07 14:02:54,034 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e9a23cbdeed13f0100ce5ce7445e651a, disabling compactions & flushes 2023-02-07 14:02:54,035 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:54,035 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:54,035 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. after waiting 0 ms 2023-02-07 14:02:54,035 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:54,045 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:54,045 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e9a23cbdeed13f0100ce5ce7445e651a: Waiting for close lock at 1675778574034Disabling compacts and flushes for region at 1675778574034Disabling writes for close at 1675778574035 (+1 ms)Writing region close event to WAL at 1675778574045 (+10 ms)Closed at 1675778574045 2023-02-07 14:02:54,050 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:54,050 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:02:54,059 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:54,069 INFO [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:54,070 DEBUG [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1 2023-02-07 14:02:54,071 INFO [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1cdf44635ff1b97044d6263fbaa981a columnFamilyName f1 2023-02-07 14:02:54,084 DEBUG [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1/testWithMapReduce=e1cdf44635ff1b97044d6263fbaa981a-905021f88ab14c8e8d221abf34af39b7 2023-02-07 14:02:54,084 INFO [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] regionserver.HStore(310): Store=e1cdf44635ff1b97044d6263fbaa981a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:54,084 INFO [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:54,086 DEBUG [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2 2023-02-07 14:02:54,086 INFO [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1cdf44635ff1b97044d6263fbaa981a columnFamilyName f2 2023-02-07 14:02:54,092 DEBUG [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2/testWithMapReduce=e1cdf44635ff1b97044d6263fbaa981a-328c20d1d3004e378680c989083bf634 2023-02-07 14:02:54,093 INFO [StoreOpener-e1cdf44635ff1b97044d6263fbaa981a-1] regionserver.HStore(310): Store=e1cdf44635ff1b97044d6263fbaa981a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:54,093 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:54,093 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e1cdf44635ff1b97044d6263fbaa981a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58992708, jitterRate=-0.12094014883041382}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:54,093 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e1cdf44635ff1b97044d6263fbaa981a: Writing region info on filesystem at 1675778574059Initializing all the Stores at 1675778574068 (+9 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778574068Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778574068Region opened successfully at 1675778574093 (+25 ms) 2023-02-07 14:02:54,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e1cdf44635ff1b97044d6263fbaa981a, disabling compactions & flushes 2023-02-07 14:02:54,125 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:54,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:54,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. after waiting 0 ms 2023-02-07 14:02:54,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:54,138 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:54,138 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e1cdf44635ff1b97044d6263fbaa981a: Waiting for close lock at 1675778574125Disabling compacts and flushes for region at 1675778574125Disabling writes for close at 1675778574125Writing region close event to WAL at 1675778574138 (+13 ms)Closed at 1675778574138 2023-02-07 14:02:54,142 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:54,142 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:02:54,156 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:54,168 INFO [StoreOpener-b3da998557027663b1b762e486d589c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b3da998557027663b1b762e486d589c3 2023-02-07 14:02:54,170 DEBUG [StoreOpener-b3da998557027663b1b762e486d589c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1 2023-02-07 14:02:54,170 INFO [StoreOpener-b3da998557027663b1b762e486d589c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3da998557027663b1b762e486d589c3 columnFamilyName f1 2023-02-07 14:02:54,178 DEBUG [StoreOpener-b3da998557027663b1b762e486d589c3-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1/testWithMapReduce=b3da998557027663b1b762e486d589c3-10f1ba8634e9436a924737c32cad653d 2023-02-07 14:02:54,178 INFO [StoreOpener-b3da998557027663b1b762e486d589c3-1] regionserver.HStore(310): Store=b3da998557027663b1b762e486d589c3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:54,179 INFO [StoreOpener-b3da998557027663b1b762e486d589c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b3da998557027663b1b762e486d589c3 2023-02-07 14:02:54,180 DEBUG [StoreOpener-b3da998557027663b1b762e486d589c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2 2023-02-07 14:02:54,180 INFO [StoreOpener-b3da998557027663b1b762e486d589c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b3da998557027663b1b762e486d589c3 columnFamilyName f2 2023-02-07 14:02:54,187 DEBUG [StoreOpener-b3da998557027663b1b762e486d589c3-1] regionserver.HStore(539): loaded hdfs://localhost:37673/user/jenkins/test-data/0c102c1d-00e4-e58f-5393-b455d99752ce/testWithMapReduceMultiRegion/03b9d837-ba5b-416a-9101-b3b1f0c9609f/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2/testWithMapReduce=b3da998557027663b1b762e486d589c3-802a3a2619df4efbba1e338f1df0abc4 2023-02-07 14:02:54,187 INFO [StoreOpener-b3da998557027663b1b762e486d589c3-1] regionserver.HStore(310): Store=b3da998557027663b1b762e486d589c3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:54,187 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:02:54,187 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b3da998557027663b1b762e486d589c3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70384775, jitterRate=0.04881487786769867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:02:54,187 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b3da998557027663b1b762e486d589c3: Writing region info on filesystem at 1675778574156Initializing all the Stores at 1675778574157 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778574157Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778574157Region opened successfully at 1675778574187 (+30 ms) 2023-02-07 14:02:54,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b3da998557027663b1b762e486d589c3, disabling compactions & flushes 2023-02-07 14:02:54,225 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:54,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:54,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. after waiting 0 ms 2023-02-07 14:02:54,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:54,229 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:54,229 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b3da998557027663b1b762e486d589c3: Waiting for close lock at 1675778574225Disabling compacts and flushes for region at 1675778574225Disabling writes for close at 1675778574225Writing region close event to WAL at 1675778574229 (+4 ms)Closed at 1675778574229 2023-02-07 14:02:55,083 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:55,083 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:55,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-07 14:02:55,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-07 14:02:55,094 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:55,094 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:55,095 INFO [Listener at localhost/40837] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 14:02:55,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-07 14:02:55,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-07 14:02:55,107 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778575106"}]},"ts":"1675778575106"} 2023-02-07 14:02:55,107 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:55,107 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:55,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 14:02:55,109 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-07 14:02:55,111 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-07 14:02:55,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4e403e3da79dd6bdefdf65e3b57bcd6f, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e9a23cbdeed13f0100ce5ce7445e651a, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3e8eb2655570dcc33e6f1d2553004acf, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=45af8e26bbb35d3c7fbeb12766ba1e5c, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e1cdf44635ff1b97044d6263fbaa981a, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=74a6ba96b740e3fd09a268bcd8453427, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8691d855b35ad124573f3d9aa7a6c525, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b3da998557027663b1b762e486d589c3, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6816d8c175af9806ef749579bd93cbf3, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=02dbd90de942d8345117748d1abdcdd3, UNASSIGN}] 2023-02-07 14:02:55,118 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b3da998557027663b1b762e486d589c3, UNASSIGN 2023-02-07 14:02:55,118 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=74a6ba96b740e3fd09a268bcd8453427, UNASSIGN 2023-02-07 14:02:55,118 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e1cdf44635ff1b97044d6263fbaa981a, UNASSIGN 2023-02-07 14:02:55,118 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8691d855b35ad124573f3d9aa7a6c525, UNASSIGN 2023-02-07 14:02:55,118 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=02dbd90de942d8345117748d1abdcdd3, UNASSIGN 2023-02-07 14:02:55,119 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=8691d855b35ad124573f3d9aa7a6c525, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:55,119 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=02dbd90de942d8345117748d1abdcdd3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:55,119 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=74a6ba96b740e3fd09a268bcd8453427, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:55,119 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=b3da998557027663b1b762e486d589c3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:55,120 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778575119"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778575119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778575119"}]},"ts":"1675778575119"} 2023-02-07 14:02:55,120 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575119"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778575119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778575119"}]},"ts":"1675778575119"} 2023-02-07 14:02:55,119 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e1cdf44635ff1b97044d6263fbaa981a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:55,120 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575119"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778575119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778575119"}]},"ts":"1675778575119"} 2023-02-07 14:02:55,120 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575119"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778575119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778575119"}]},"ts":"1675778575119"} 2023-02-07 14:02:55,120 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575119"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778575119"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778575119"}]},"ts":"1675778575119"} 2023-02-07 14:02:55,122 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE; CloseRegionProcedure 02dbd90de942d8345117748d1abdcdd3, server=jenkins-hbase4.apache.org,42681,1675778562998}] 2023-02-07 14:02:55,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=41, state=RUNNABLE; CloseRegionProcedure b3da998557027663b1b762e486d589c3, server=jenkins-hbase4.apache.org,42681,1675778562998}] 2023-02-07 14:02:55,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=39, state=RUNNABLE; CloseRegionProcedure 74a6ba96b740e3fd09a268bcd8453427, server=jenkins-hbase4.apache.org,42681,1675778562998}] 2023-02-07 14:02:55,125 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=38, state=RUNNABLE; CloseRegionProcedure e1cdf44635ff1b97044d6263fbaa981a, server=jenkins-hbase4.apache.org,35817,1675778562952}] 2023-02-07 14:02:55,126 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=40, state=RUNNABLE; CloseRegionProcedure 8691d855b35ad124573f3d9aa7a6c525, server=jenkins-hbase4.apache.org,35817,1675778562952}] 2023-02-07 14:02:55,132 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=6816d8c175af9806ef749579bd93cbf3, UNASSIGN 2023-02-07 14:02:55,132 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=45af8e26bbb35d3c7fbeb12766ba1e5c, UNASSIGN 2023-02-07 14:02:55,132 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=3e8eb2655570dcc33e6f1d2553004acf, UNASSIGN 2023-02-07 14:02:55,133 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e9a23cbdeed13f0100ce5ce7445e651a, UNASSIGN 2023-02-07 14:02:55,133 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=4e403e3da79dd6bdefdf65e3b57bcd6f, UNASSIGN 2023-02-07 14:02:55,133 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=6816d8c175af9806ef749579bd93cbf3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:55,134 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=45af8e26bbb35d3c7fbeb12766ba1e5c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:55,134 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575133"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778575133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778575133"}]},"ts":"1675778575133"} 2023-02-07 14:02:55,134 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575133"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778575133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778575133"}]},"ts":"1675778575133"} 2023-02-07 14:02:55,134 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e9a23cbdeed13f0100ce5ce7445e651a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:55,134 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575134"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778575134"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778575134"}]},"ts":"1675778575134"} 2023-02-07 14:02:55,134 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=4e403e3da79dd6bdefdf65e3b57bcd6f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:55,135 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778575134"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778575134"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778575134"}]},"ts":"1675778575134"} 2023-02-07 14:02:55,134 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=3e8eb2655570dcc33e6f1d2553004acf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:55,135 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575134"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778575134"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778575134"}]},"ts":"1675778575134"} 2023-02-07 14:02:55,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 6816d8c175af9806ef749579bd93cbf3, server=jenkins-hbase4.apache.org,35817,1675778562952}] 2023-02-07 14:02:55,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure 45af8e26bbb35d3c7fbeb12766ba1e5c, server=jenkins-hbase4.apache.org,42681,1675778562998}] 2023-02-07 14:02:55,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=35, state=RUNNABLE; CloseRegionProcedure e9a23cbdeed13f0100ce5ce7445e651a, server=jenkins-hbase4.apache.org,35817,1675778562952}] 2023-02-07 14:02:55,140 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=34, state=RUNNABLE; CloseRegionProcedure 4e403e3da79dd6bdefdf65e3b57bcd6f, server=jenkins-hbase4.apache.org,42681,1675778562998}] 2023-02-07 14:02:55,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=36, state=RUNNABLE; CloseRegionProcedure 3e8eb2655570dcc33e6f1d2553004acf, server=jenkins-hbase4.apache.org,35817,1675778562952}] 2023-02-07 14:02:55,208 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:55,209 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:55,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 14:02:55,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b3da998557027663b1b762e486d589c3 2023-02-07 14:02:55,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b3da998557027663b1b762e486d589c3, disabling compactions & flushes 2023-02-07 14:02:55,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:55,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:55,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6816d8c175af9806ef749579bd93cbf3, disabling compactions & flushes 2023-02-07 14:02:55,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:55,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:55,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:55,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. after waiting 0 ms 2023-02-07 14:02:55,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:55,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. after waiting 0 ms 2023-02-07 14:02:55,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:55,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:02:55,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:02:55,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3. 2023-02-07 14:02:55,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6816d8c175af9806ef749579bd93cbf3: Waiting for close lock at 1675778575285Running coprocessor pre-close hooks at 1675778575285Disabling compacts and flushes for region at 1675778575285Disabling writes for close at 1675778575285Writing region close event to WAL at 1675778575298 (+13 ms)Running coprocessor post-close hooks at 1675778575304 (+6 ms)Closed at 1675778575305 (+1 ms) 2023-02-07 14:02:55,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3. 2023-02-07 14:02:55,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b3da998557027663b1b762e486d589c3: Waiting for close lock at 1675778575284Running coprocessor pre-close hooks at 1675778575284Disabling compacts and flushes for region at 1675778575284Disabling writes for close at 1675778575285 (+1 ms)Writing region close event to WAL at 1675778575297 (+12 ms)Running coprocessor post-close hooks at 1675778575305 (+8 ms)Closed at 1675778575306 (+1 ms) 2023-02-07 14:02:55,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:55,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:55,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e9a23cbdeed13f0100ce5ce7445e651a, disabling compactions & flushes 2023-02-07 14:02:55,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:55,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:55,309 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=6816d8c175af9806ef749579bd93cbf3, regionState=CLOSED 2023-02-07 14:02:55,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. after waiting 0 ms 2023-02-07 14:02:55,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:55,310 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575309"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778575309"}]},"ts":"1675778575309"} 2023-02-07 14:02:55,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b3da998557027663b1b762e486d589c3 2023-02-07 14:02:55,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:55,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4e403e3da79dd6bdefdf65e3b57bcd6f, disabling compactions & flushes 2023-02-07 14:02:55,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:55,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:55,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. after waiting 0 ms 2023-02-07 14:02:55,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:55,312 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=b3da998557027663b1b762e486d589c3, regionState=CLOSED 2023-02-07 14:02:55,312 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778575312"}]},"ts":"1675778575312"} 2023-02-07 14:02:55,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-07 14:02:55,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 6816d8c175af9806ef749579bd93cbf3, server=jenkins-hbase4.apache.org,35817,1675778562952 in 176 msec 2023-02-07 14:02:55,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=41 2023-02-07 14:02:55,319 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=41, state=SUCCESS; CloseRegionProcedure b3da998557027663b1b762e486d589c3, server=jenkins-hbase4.apache.org,42681,1675778562998 in 191 msec 2023-02-07 14:02:55,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=6816d8c175af9806ef749579bd93cbf3, UNASSIGN in 201 msec 2023-02-07 14:02:55,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 14:02:55,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b3da998557027663b1b762e486d589c3, UNASSIGN in 206 msec 2023-02-07 14:02:55,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f. 2023-02-07 14:02:55,329 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4e403e3da79dd6bdefdf65e3b57bcd6f: Waiting for close lock at 1675778575311Running coprocessor pre-close hooks at 1675778575311Disabling compacts and flushes for region at 1675778575311Disabling writes for close at 1675778575311Writing region close event to WAL at 1675778575319 (+8 ms)Running coprocessor post-close hooks at 1675778575328 (+9 ms)Closed at 1675778575329 (+1 ms) 2023-02-07 14:02:55,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:02:55,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:55,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:55,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 02dbd90de942d8345117748d1abdcdd3, disabling compactions & flushes 2023-02-07 14:02:55,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:55,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:55,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. after waiting 0 ms 2023-02-07 14:02:55,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:55,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a. 2023-02-07 14:02:55,333 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=4e403e3da79dd6bdefdf65e3b57bcd6f, regionState=CLOSED 2023-02-07 14:02:55,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e9a23cbdeed13f0100ce5ce7445e651a: Waiting for close lock at 1675778575309Running coprocessor pre-close hooks at 1675778575309Disabling compacts and flushes for region at 1675778575309Disabling writes for close at 1675778575309Writing region close event to WAL at 1675778575326 (+17 ms)Running coprocessor post-close hooks at 1675778575332 (+6 ms)Closed at 1675778575333 (+1 ms) 2023-02-07 14:02:55,333 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778575333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778575333"}]},"ts":"1675778575333"} 2023-02-07 14:02:55,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:55,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:55,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3e8eb2655570dcc33e6f1d2553004acf, disabling compactions & flushes 2023-02-07 14:02:55,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:55,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:55,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. after waiting 0 ms 2023-02-07 14:02:55,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:55,337 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e9a23cbdeed13f0100ce5ce7445e651a, regionState=CLOSED 2023-02-07 14:02:55,337 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575337"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778575337"}]},"ts":"1675778575337"} 2023-02-07 14:02:55,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=34 2023-02-07 14:02:55,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=34, state=SUCCESS; CloseRegionProcedure 4e403e3da79dd6bdefdf65e3b57bcd6f, server=jenkins-hbase4.apache.org,42681,1675778562998 in 196 msec 2023-02-07 14:02:55,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4e403e3da79dd6bdefdf65e3b57bcd6f, UNASSIGN in 227 msec 2023-02-07 14:02:55,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=35 2023-02-07 14:02:55,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=35, state=SUCCESS; CloseRegionProcedure e9a23cbdeed13f0100ce5ce7445e651a, server=jenkins-hbase4.apache.org,35817,1675778562952 in 200 msec 2023-02-07 14:02:55,344 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e9a23cbdeed13f0100ce5ce7445e651a, UNASSIGN in 229 msec 2023-02-07 14:02:55,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 14:02:55,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3. 2023-02-07 14:02:55,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 02dbd90de942d8345117748d1abdcdd3: Waiting for close lock at 1675778575332Running coprocessor pre-close hooks at 1675778575332Disabling compacts and flushes for region at 1675778575332Disabling writes for close at 1675778575332Writing region close event to WAL at 1675778575333 (+1 ms)Running coprocessor post-close hooks at 1675778575357 (+24 ms)Closed at 1675778575358 (+1 ms) 2023-02-07 14:02:55,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:55,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:55,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 74a6ba96b740e3fd09a268bcd8453427, disabling compactions & flushes 2023-02-07 14:02:55,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:55,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:55,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. after waiting 0 ms 2023-02-07 14:02:55,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:55,361 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=02dbd90de942d8345117748d1abdcdd3, regionState=CLOSED 2023-02-07 14:02:55,361 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778575361"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778575361"}]},"ts":"1675778575361"} 2023-02-07 14:02:55,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-07 14:02:55,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; CloseRegionProcedure 02dbd90de942d8345117748d1abdcdd3, server=jenkins-hbase4.apache.org,42681,1675778562998 in 243 msec 2023-02-07 14:02:55,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=02dbd90de942d8345117748d1abdcdd3, UNASSIGN in 252 msec 2023-02-07 14:02:55,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:02:55,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf. 2023-02-07 14:02:55,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3e8eb2655570dcc33e6f1d2553004acf: Waiting for close lock at 1675778575336Running coprocessor pre-close hooks at 1675778575336Disabling compacts and flushes for region at 1675778575336Disabling writes for close at 1675778575336Writing region close event to WAL at 1675778575358 (+22 ms)Running coprocessor post-close hooks at 1675778575376 (+18 ms)Closed at 1675778575376 2023-02-07 14:02:55,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:55,379 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=3e8eb2655570dcc33e6f1d2553004acf, regionState=CLOSED 2023-02-07 14:02:55,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:55,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e1cdf44635ff1b97044d6263fbaa981a, disabling compactions & flushes 2023-02-07 14:02:55,380 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575379"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778575379"}]},"ts":"1675778575379"} 2023-02-07 14:02:55,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:55,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:55,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. after waiting 0 ms 2023-02-07 14:02:55,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:55,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:02:55,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427. 2023-02-07 14:02:55,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 74a6ba96b740e3fd09a268bcd8453427: Waiting for close lock at 1675778575360Running coprocessor pre-close hooks at 1675778575360Disabling compacts and flushes for region at 1675778575360Disabling writes for close at 1675778575361 (+1 ms)Writing region close event to WAL at 1675778575374 (+13 ms)Running coprocessor post-close hooks at 1675778575382 (+8 ms)Closed at 1675778575383 (+1 ms) 2023-02-07 14:02:55,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:55,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:55,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 45af8e26bbb35d3c7fbeb12766ba1e5c, disabling compactions & flushes 2023-02-07 14:02:55,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:55,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:55,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. after waiting 0 ms 2023-02-07 14:02:55,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:55,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=36 2023-02-07 14:02:55,387 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=74a6ba96b740e3fd09a268bcd8453427, regionState=CLOSED 2023-02-07 14:02:55,387 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575387"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778575387"}]},"ts":"1675778575387"} 2023-02-07 14:02:55,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=36, state=SUCCESS; CloseRegionProcedure 3e8eb2655570dcc33e6f1d2553004acf, server=jenkins-hbase4.apache.org,35817,1675778562952 in 242 msec 2023-02-07 14:02:55,391 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3e8eb2655570dcc33e6f1d2553004acf, UNASSIGN in 274 msec 2023-02-07 14:02:55,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=39 2023-02-07 14:02:55,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=39, state=SUCCESS; CloseRegionProcedure 74a6ba96b740e3fd09a268bcd8453427, server=jenkins-hbase4.apache.org,42681,1675778562998 in 266 msec 2023-02-07 14:02:55,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=74a6ba96b740e3fd09a268bcd8453427, UNASSIGN in 280 msec 2023-02-07 14:02:55,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:02:55,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a. 2023-02-07 14:02:55,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e1cdf44635ff1b97044d6263fbaa981a: Waiting for close lock at 1675778575380Running coprocessor pre-close hooks at 1675778575380Disabling compacts and flushes for region at 1675778575380Disabling writes for close at 1675778575380Writing region close event to WAL at 1675778575394 (+14 ms)Running coprocessor post-close hooks at 1675778575400 (+6 ms)Closed at 1675778575401 (+1 ms) 2023-02-07 14:02:55,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:02:55,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c. 2023-02-07 14:02:55,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 45af8e26bbb35d3c7fbeb12766ba1e5c: Waiting for close lock at 1675778575386Running coprocessor pre-close hooks at 1675778575386Disabling compacts and flushes for region at 1675778575386Disabling writes for close at 1675778575386Writing region close event to WAL at 1675778575395 (+9 ms)Running coprocessor post-close hooks at 1675778575402 (+7 ms)Closed at 1675778575403 (+1 ms) 2023-02-07 14:02:55,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:55,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:55,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8691d855b35ad124573f3d9aa7a6c525, disabling compactions & flushes 2023-02-07 14:02:55,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:55,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:55,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. after waiting 0 ms 2023-02-07 14:02:55,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:55,405 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e1cdf44635ff1b97044d6263fbaa981a, regionState=CLOSED 2023-02-07 14:02:55,405 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575405"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778575405"}]},"ts":"1675778575405"} 2023-02-07 14:02:55,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:55,407 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=45af8e26bbb35d3c7fbeb12766ba1e5c, regionState=CLOSED 2023-02-07 14:02:55,408 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575407"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778575407"}]},"ts":"1675778575407"} 2023-02-07 14:02:55,411 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:55,411 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:55,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=38 2023-02-07 14:02:55,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 14:02:55,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=38, state=SUCCESS; CloseRegionProcedure e1cdf44635ff1b97044d6263fbaa981a, server=jenkins-hbase4.apache.org,35817,1675778562952 in 283 msec 2023-02-07 14:02:55,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-07 14:02:55,414 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure 45af8e26bbb35d3c7fbeb12766ba1e5c, server=jenkins-hbase4.apache.org,42681,1675778562998 in 273 msec 2023-02-07 14:02:55,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e1cdf44635ff1b97044d6263fbaa981a, UNASSIGN in 300 msec 2023-02-07 14:02:55,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=45af8e26bbb35d3c7fbeb12766ba1e5c, UNASSIGN in 301 msec 2023-02-07 14:02:55,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:02:55,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525. 2023-02-07 14:02:55,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8691d855b35ad124573f3d9aa7a6c525: Waiting for close lock at 1675778575404Running coprocessor pre-close hooks at 1675778575404Disabling compacts and flushes for region at 1675778575404Disabling writes for close at 1675778575405 (+1 ms)Writing region close event to WAL at 1675778575421 (+16 ms)Running coprocessor post-close hooks at 1675778575427 (+6 ms)Closed at 1675778575428 (+1 ms) 2023-02-07 14:02:55,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:55,431 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=8691d855b35ad124573f3d9aa7a6c525, regionState=CLOSED 2023-02-07 14:02:55,431 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778575431"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778575431"}]},"ts":"1675778575431"} 2023-02-07 14:02:55,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=40 2023-02-07 14:02:55,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=40, state=SUCCESS; CloseRegionProcedure 8691d855b35ad124573f3d9aa7a6c525, server=jenkins-hbase4.apache.org,35817,1675778562952 in 307 msec 2023-02-07 14:02:55,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=33 2023-02-07 14:02:55,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8691d855b35ad124573f3d9aa7a6c525, UNASSIGN in 322 msec 2023-02-07 14:02:55,438 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778575438"}]},"ts":"1675778575438"} 2023-02-07 14:02:55,440 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-07 14:02:55,442 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-07 14:02:55,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 345 msec 2023-02-07 14:02:55,713 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:55,713 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:55,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 14:02:55,715 INFO [Listener at localhost/40837] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-07 14:02:55,716 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:55,716 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:55,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-07 14:02:55,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-07 14:02:55,728 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 14:02:55,730 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 14:02:55,730 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:55,730 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:55,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 14:02:55,746 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:55,746 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:55,746 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:55,746 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:55,746 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3 2023-02-07 14:02:55,746 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:55,746 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:55,746 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:55,752 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f/recovered.edits] 2023-02-07 14:02:55,753 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/recovered.edits] 2023-02-07 14:02:55,754 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/recovered.edits] 2023-02-07 14:02:55,754 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/recovered.edits] 2023-02-07 14:02:55,755 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/recovered.edits] 2023-02-07 14:02:55,755 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/recovered.edits] 2023-02-07 14:02:55,757 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/recovered.edits] 2023-02-07 14:02:55,757 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/recovered.edits] 2023-02-07 14:02:55,768 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1/10f1ba8634e9436a924737c32cad653d to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1/10f1ba8634e9436a924737c32cad653d 2023-02-07 14:02:55,770 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1/a3dcbaa429e1465f9d07fadad231ce54 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1/a3dcbaa429e1465f9d07fadad231ce54 2023-02-07 14:02:55,770 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1/78221aa9e37e459e8fe449828051c4aa to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1/78221aa9e37e459e8fe449828051c4aa 2023-02-07 14:02:55,770 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1/4144f0ea70484a79b7f4f9e2e3ca89d7 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1/4144f0ea70484a79b7f4f9e2e3ca89d7 2023-02-07 14:02:55,770 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1/4549f6757c38475997008fb13b8dc71c to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1/4549f6757c38475997008fb13b8dc71c 2023-02-07 14:02:55,772 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f/recovered.edits/6.seqid to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f/recovered.edits/6.seqid 2023-02-07 14:02:55,772 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1/d21ce6d709b74791a5a3f9b6a4c29180 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1/d21ce6d709b74791a5a3f9b6a4c29180 2023-02-07 14:02:55,773 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1/905021f88ab14c8e8d221abf34af39b7 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1/905021f88ab14c8e8d221abf34af39b7 2023-02-07 14:02:55,773 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/4e403e3da79dd6bdefdf65e3b57bcd6f 2023-02-07 14:02:55,773 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:55,775 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1/5cca269bdfaf4e96ae0f0b1b856e7ba3 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f1/5cca269bdfaf4e96ae0f0b1b856e7ba3 2023-02-07 14:02:55,775 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1/f2d3d62d14104b4d84656807ab9ae794 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f1/f2d3d62d14104b4d84656807ab9ae794 2023-02-07 14:02:55,775 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1/d4f0f457836c474983d8874e2aabe850 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f1/d4f0f457836c474983d8874e2aabe850 2023-02-07 14:02:55,776 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1/a26c28bb5f134693961d1d3e93909d2d to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f1/a26c28bb5f134693961d1d3e93909d2d 2023-02-07 14:02:55,776 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1/ea11994f28c244ca8eea4adabb3a10be to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f1/ea11994f28c244ca8eea4adabb3a10be 2023-02-07 14:02:55,777 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1/e520c455977c400a969f1887fb268c00 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f1/e520c455977c400a969f1887fb268c00 2023-02-07 14:02:55,777 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1/ff025e92c92b4f1988e3d4d115f68b02 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f1/ff025e92c92b4f1988e3d4d115f68b02 2023-02-07 14:02:55,779 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/recovered.edits] 2023-02-07 14:02:55,788 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2/3afb7cb49ca144c396b1aec27d1f35f9 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2/3afb7cb49ca144c396b1aec27d1f35f9 2023-02-07 14:02:55,788 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2/3f0d242871b34ea794aac28a80d91f07 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2/3f0d242871b34ea794aac28a80d91f07 2023-02-07 14:02:55,788 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2/328c20d1d3004e378680c989083bf634 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2/328c20d1d3004e378680c989083bf634 2023-02-07 14:02:55,789 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2/802a3a2619df4efbba1e338f1df0abc4 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2/802a3a2619df4efbba1e338f1df0abc4 2023-02-07 14:02:55,789 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2/8cf0d0575a3b4c9c8a22d0f657314094 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2/8cf0d0575a3b4c9c8a22d0f657314094 2023-02-07 14:02:55,789 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2/6ea6c77ef27e489eb839537e38e8c93d to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2/6ea6c77ef27e489eb839537e38e8c93d 2023-02-07 14:02:55,789 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2/21ef149e36644b81bac544390e1b44a3 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2/21ef149e36644b81bac544390e1b44a3 2023-02-07 14:02:55,793 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2/be67593c7c31441ebf4376c37b91ab5e to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/f2/be67593c7c31441ebf4376c37b91ab5e 2023-02-07 14:02:55,793 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2/5bccbda8f0e348858909192b1ad48304 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/f2/5bccbda8f0e348858909192b1ad48304 2023-02-07 14:02:55,793 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2/7bd9b6fcddaa4358a014d76e83a1222d to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/f2/7bd9b6fcddaa4358a014d76e83a1222d 2023-02-07 14:02:55,794 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2/dd5a6d74a24444888657308b54817c11 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/f2/dd5a6d74a24444888657308b54817c11 2023-02-07 14:02:55,794 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2/a0dfb9c82e7441b18a2dd88a7a2a06f6 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/f2/a0dfb9c82e7441b18a2dd88a7a2a06f6 2023-02-07 14:02:55,794 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1/1151a8a727424ea69ea0047302a18f1d to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1/1151a8a727424ea69ea0047302a18f1d 2023-02-07 14:02:55,795 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2/a0411187c88f43c0a62ee80ab84d1ed0 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/f2/a0411187c88f43c0a62ee80ab84d1ed0 2023-02-07 14:02:55,795 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2/d843494f89674616ac927523d0f70e8b to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/f2/d843494f89674616ac927523d0f70e8b 2023-02-07 14:02:55,800 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1/46991fbc73244343a3f208783672d679 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f1/46991fbc73244343a3f208783672d679 2023-02-07 14:02:55,805 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525/recovered.edits/12.seqid 2023-02-07 14:02:55,806 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a/recovered.edits/12.seqid 2023-02-07 14:02:55,806 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a/recovered.edits/12.seqid 2023-02-07 14:02:55,806 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3/recovered.edits/12.seqid 2023-02-07 14:02:55,807 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427/recovered.edits/12.seqid 2023-02-07 14:02:55,807 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/8691d855b35ad124573f3d9aa7a6c525 2023-02-07 14:02:55,807 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:55,807 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c/recovered.edits/12.seqid 2023-02-07 14:02:55,808 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf/recovered.edits/12.seqid 2023-02-07 14:02:55,808 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e1cdf44635ff1b97044d6263fbaa981a 2023-02-07 14:02:55,808 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/b3da998557027663b1b762e486d589c3 2023-02-07 14:02:55,808 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/74a6ba96b740e3fd09a268bcd8453427 2023-02-07 14:02:55,809 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/e9a23cbdeed13f0100ce5ce7445e651a 2023-02-07 14:02:55,809 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/45af8e26bbb35d3c7fbeb12766ba1e5c 2023-02-07 14:02:55,809 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/3e8eb2655570dcc33e6f1d2553004acf 2023-02-07 14:02:55,810 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3/f1, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3/f2, FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3/recovered.edits] 2023-02-07 14:02:55,812 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2/00d674550f3c4a8eb3430697a3c0e9e0 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2/00d674550f3c4a8eb3430697a3c0e9e0 2023-02-07 14:02:55,814 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2/ca8f6eeaeeba4b18a9ba2584afc4ee36 to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/f2/ca8f6eeaeeba4b18a9ba2584afc4ee36 2023-02-07 14:02:55,818 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/recovered.edits/12.seqid to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3/recovered.edits/12.seqid 2023-02-07 14:02:55,818 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3/recovered.edits/6.seqid to hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/archive/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3/recovered.edits/6.seqid 2023-02-07 14:02:55,819 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/6816d8c175af9806ef749579bd93cbf3 2023-02-07 14:02:55,819 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/.tmp/data/default/testWithMapReduce/02dbd90de942d8345117748d1abdcdd3 2023-02-07 14:02:55,819 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 14:02:55,822 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 14:02:55,832 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:55,832 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:55,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 14:02:55,849 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-07 14:02:55,853 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-07 14:02:55,855 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 14:02:55,855 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-07 14:02:55,855 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778575855"}]},"ts":"9223372036854775807"} 2023-02-07 14:02:55,855 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778575855"}]},"ts":"9223372036854775807"} 2023-02-07 14:02:55,855 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778575855"}]},"ts":"9223372036854775807"} 2023-02-07 14:02:55,855 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778575855"}]},"ts":"9223372036854775807"} 2023-02-07 14:02:55,856 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778575855"}]},"ts":"9223372036854775807"} 2023-02-07 14:02:55,856 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778575855"}]},"ts":"9223372036854775807"} 2023-02-07 14:02:55,856 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778575855"}]},"ts":"9223372036854775807"} 2023-02-07 14:02:55,856 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778575855"}]},"ts":"9223372036854775807"} 2023-02-07 14:02:55,856 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778575855"}]},"ts":"9223372036854775807"} 2023-02-07 14:02:55,856 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778575855"}]},"ts":"9223372036854775807"} 2023-02-07 14:02:55,858 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-07 14:02:55,858 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4e403e3da79dd6bdefdf65e3b57bcd6f, NAME => 'testWithMapReduce,,1675778565858.4e403e3da79dd6bdefdf65e3b57bcd6f.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => e9a23cbdeed13f0100ce5ce7445e651a, NAME => 'testWithMapReduce,aaa,1675778565858.e9a23cbdeed13f0100ce5ce7445e651a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 3e8eb2655570dcc33e6f1d2553004acf, NAME => 'testWithMapReduce,d\x84\x84,1675778565858.3e8eb2655570dcc33e6f1d2553004acf.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 45af8e26bbb35d3c7fbeb12766ba1e5c, NAME => 'testWithMapReduce,g\xA7\xA7,1675778565858.45af8e26bbb35d3c7fbeb12766ba1e5c.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => e1cdf44635ff1b97044d6263fbaa981a, NAME => 'testWithMapReduce,j\xCA\xCA,1675778565858.e1cdf44635ff1b97044d6263fbaa981a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 74a6ba96b740e3fd09a268bcd8453427, NAME => 'testWithMapReduce,m\xED\xED,1675778565858.74a6ba96b740e3fd09a268bcd8453427.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 8691d855b35ad124573f3d9aa7a6c525, NAME => 'testWithMapReduce,q\x11\x10,1675778565858.8691d855b35ad124573f3d9aa7a6c525.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => b3da998557027663b1b762e486d589c3, NAME => 'testWithMapReduce,t43,1675778565858.b3da998557027663b1b762e486d589c3.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 6816d8c175af9806ef749579bd93cbf3, NAME => 'testWithMapReduce,wWV,1675778565858.6816d8c175af9806ef749579bd93cbf3.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 02dbd90de942d8345117748d1abdcdd3, NAME => 'testWithMapReduce,zz{,1675778565858.02dbd90de942d8345117748d1abdcdd3.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-07 14:02:55,859 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-07 14:02:55,859 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675778575859"}]},"ts":"9223372036854775807"} 2023-02-07 14:02:55,861 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-07 14:02:55,865 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 14:02:55,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 144 msec 2023-02-07 14:02:56,034 INFO [Listener at localhost/40837] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:56,034 INFO [Listener at localhost/40837] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:56,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39545] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 14:02:56,037 INFO [Listener at localhost/40837] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-07 14:02:56,037 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 14:02:56,037 INFO [Listener at localhost/40837] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 14:02:56,037 DEBUG [Listener at localhost/40837] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54183f42 to 127.0.0.1:55354 2023-02-07 14:02:56,038 DEBUG [Listener at localhost/40837] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:02:56,038 DEBUG [Listener at localhost/40837] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 14:02:56,038 DEBUG [Listener at localhost/40837] util.JVMClusterUtil(257): Found active master hash=249715283, stopped=false 2023-02-07 14:02:56,038 INFO [Listener at localhost/40837] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39545,1675778561731 2023-02-07 14:02:56,041 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:02:56,041 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:02:56,041 INFO [Listener at localhost/40837] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 14:02:56,041 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:56,041 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:02:56,042 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:02:56,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:02:56,043 DEBUG [Listener at localhost/40837] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x620aabf7 to 127.0.0.1:55354 2023-02-07 14:02:56,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:02:56,043 DEBUG [Listener at localhost/40837] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:02:56,043 INFO [Listener at localhost/40837] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35817,1675778562952' ***** 2023-02-07 14:02:56,043 INFO [Listener at localhost/40837] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:02:56,043 INFO [Listener at localhost/40837] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42681,1675778562998' ***** 2023-02-07 14:02:56,043 INFO [Listener at localhost/40837] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:02:56,043 INFO [RS:0;jenkins-hbase4:35817] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:02:56,044 INFO [RS:1;jenkins-hbase4:42681] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:02:56,044 INFO [RS:1;jenkins-hbase4:42681] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:02:56,044 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:02:56,044 INFO [RS:1;jenkins-hbase4:42681] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:02:56,044 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:02:56,044 INFO [RS:0;jenkins-hbase4:35817] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:02:56,045 INFO [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(3304): Received CLOSE for 66d97a88fe08e7a64e965d45f6523e50 2023-02-07 14:02:56,045 INFO [RS:0;jenkins-hbase4:35817] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:02:56,045 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:56,046 DEBUG [RS:0;jenkins-hbase4:35817] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29ed6361 to 127.0.0.1:55354 2023-02-07 14:02:56,046 INFO [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:56,046 DEBUG [RS:0;jenkins-hbase4:35817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:02:56,046 DEBUG [RS:1;jenkins-hbase4:42681] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x351fe54d to 127.0.0.1:55354 2023-02-07 14:02:56,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 66d97a88fe08e7a64e965d45f6523e50, disabling compactions & flushes 2023-02-07 14:02:56,046 INFO [RS:0;jenkins-hbase4:35817] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:02:56,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. 2023-02-07 14:02:56,046 DEBUG [RS:1;jenkins-hbase4:42681] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:02:56,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. 2023-02-07 14:02:56,046 INFO [RS:0;jenkins-hbase4:35817] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:02:56,047 INFO [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 14:02:56,047 INFO [RS:0;jenkins-hbase4:35817] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:02:56,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. after waiting 0 ms 2023-02-07 14:02:56,047 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 14:02:56,047 DEBUG [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(1479): Online Regions={66d97a88fe08e7a64e965d45f6523e50=hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50.} 2023-02-07 14:02:56,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. 2023-02-07 14:02:56,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 66d97a88fe08e7a64e965d45f6523e50 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 14:02:56,047 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 14:02:56,047 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-07 14:02:56,048 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:02:56,048 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:02:56,048 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:02:56,048 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:02:56,048 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:02:56,049 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-07 14:02:56,049 DEBUG [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 14:02:56,049 DEBUG [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(1505): Waiting on 66d97a88fe08e7a64e965d45f6523e50 2023-02-07 14:02:56,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/namespace/66d97a88fe08e7a64e965d45f6523e50/.tmp/info/1ab3fbc320e340f5bb27bbee33ea1197 2023-02-07 14:02:56,071 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/.tmp/info/bd14498e9b1d488ea82ccccf70afedb7 2023-02-07 14:02:56,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/namespace/66d97a88fe08e7a64e965d45f6523e50/.tmp/info/1ab3fbc320e340f5bb27bbee33ea1197 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/namespace/66d97a88fe08e7a64e965d45f6523e50/info/1ab3fbc320e340f5bb27bbee33ea1197 2023-02-07 14:02:56,077 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd14498e9b1d488ea82ccccf70afedb7 2023-02-07 14:02:56,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/namespace/66d97a88fe08e7a64e965d45f6523e50/info/1ab3fbc320e340f5bb27bbee33ea1197, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 14:02:56,080 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 66d97a88fe08e7a64e965d45f6523e50 in 33ms, sequenceid=6, compaction requested=false 2023-02-07 14:02:56,089 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:02:56,089 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:02:56,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/namespace/66d97a88fe08e7a64e965d45f6523e50/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 14:02:56,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. 2023-02-07 14:02:56,098 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/.tmp/rep_barrier/c3c1e3180d014297bf1f3e732033df1c 2023-02-07 14:02:56,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 66d97a88fe08e7a64e965d45f6523e50: Waiting for close lock at 1675778576046Running coprocessor pre-close hooks at 1675778576046Disabling compacts and flushes for region at 1675778576046Disabling writes for close at 1675778576047 (+1 ms)Obtaining lock to block concurrent updates at 1675778576047Preparing flush snapshotting stores in 66d97a88fe08e7a64e965d45f6523e50 at 1675778576047Finished memstore snapshotting hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675778576047Flushing stores of hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. at 1675778576049 (+2 ms)Flushing 66d97a88fe08e7a64e965d45f6523e50/info: creating writer at 1675778576050 (+1 ms)Flushing 66d97a88fe08e7a64e965d45f6523e50/info: appending metadata at 1675778576053 (+3 ms)Flushing 66d97a88fe08e7a64e965d45f6523e50/info: closing flushed file at 1675778576053Flushing 66d97a88fe08e7a64e965d45f6523e50/info: reopening flushed file at 1675778576073 (+20 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 66d97a88fe08e7a64e965d45f6523e50 in 33ms, sequenceid=6, compaction requested=false at 1675778576080 (+7 ms)Writing region close event to WAL at 1675778576088 (+8 ms)Running coprocessor post-close hooks at 1675778576097 (+9 ms)Closed at 1675778576097 2023-02-07 14:02:56,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675778565018.66d97a88fe08e7a64e965d45f6523e50. 2023-02-07 14:02:56,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3c1e3180d014297bf1f3e732033df1c 2023-02-07 14:02:56,118 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/.tmp/table/c434ab2c01e544af9c17a207fc9c80a3 2023-02-07 14:02:56,125 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c434ab2c01e544af9c17a207fc9c80a3 2023-02-07 14:02:56,126 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/.tmp/info/bd14498e9b1d488ea82ccccf70afedb7 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/info/bd14498e9b1d488ea82ccccf70afedb7 2023-02-07 14:02:56,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd14498e9b1d488ea82ccccf70afedb7 2023-02-07 14:02:56,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/info/bd14498e9b1d488ea82ccccf70afedb7, entries=30, sequenceid=57, filesize=7.9 K 2023-02-07 14:02:56,134 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/.tmp/rep_barrier/c3c1e3180d014297bf1f3e732033df1c as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/rep_barrier/c3c1e3180d014297bf1f3e732033df1c 2023-02-07 14:02:56,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3c1e3180d014297bf1f3e732033df1c 2023-02-07 14:02:56,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/rep_barrier/c3c1e3180d014297bf1f3e732033df1c, entries=10, sequenceid=57, filesize=5.9 K 2023-02-07 14:02:56,142 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/.tmp/table/c434ab2c01e544af9c17a207fc9c80a3 as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/table/c434ab2c01e544af9c17a207fc9c80a3 2023-02-07 14:02:56,149 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c434ab2c01e544af9c17a207fc9c80a3 2023-02-07 14:02:56,149 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/table/c434ab2c01e544af9c17a207fc9c80a3, entries=13, sequenceid=57, filesize=5.9 K 2023-02-07 14:02:56,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 102ms, sequenceid=57, compaction requested=false 2023-02-07 14:02:56,161 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-07 14:02:56,162 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 14:02:56,163 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:02:56,163 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778576047Running coprocessor pre-close hooks at 1675778576047Disabling compacts and flushes for region at 1675778576047Disabling writes for close at 1675778576048 (+1 ms)Obtaining lock to block concurrent updates at 1675778576049 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1675778576049Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1675778576049Flushing stores of hbase:meta,,1.1588230740 at 1675778576050 (+1 ms)Flushing 1588230740/info: creating writer at 1675778576050Flushing 1588230740/info: appending metadata at 1675778576055 (+5 ms)Flushing 1588230740/info: closing flushed file at 1675778576055Flushing 1588230740/rep_barrier: creating writer at 1675778576078 (+23 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675778576081 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675778576081Flushing 1588230740/table: creating writer at 1675778576104 (+23 ms)Flushing 1588230740/table: appending metadata at 1675778576108 (+4 ms)Flushing 1588230740/table: closing flushed file at 1675778576108Flushing 1588230740/info: reopening flushed file at 1675778576126 (+18 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675778576135 (+9 ms)Flushing 1588230740/table: reopening flushed file at 1675778576143 (+8 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 102ms, sequenceid=57, compaction requested=false at 1675778576150 (+7 ms)Writing region close event to WAL at 1675778576157 (+7 ms)Running coprocessor post-close hooks at 1675778576162 (+5 ms)Closed at 1675778576163 (+1 ms) 2023-02-07 14:02:56,163 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 14:02:56,250 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35817,1675778562952; all regions closed. 2023-02-07 14:02:56,250 INFO [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42681,1675778562998; all regions closed. 2023-02-07 14:02:56,261 DEBUG [RS:0;jenkins-hbase4:35817] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/oldWALs 2023-02-07 14:02:56,262 INFO [RS:0;jenkins-hbase4:35817] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35817%2C1675778562952.meta:.meta(num 1675778564756) 2023-02-07 14:02:56,262 DEBUG [RS:1;jenkins-hbase4:42681] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/oldWALs 2023-02-07 14:02:56,262 INFO [RS:1;jenkins-hbase4:42681] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42681%2C1675778562998:(num 1675778565487) 2023-02-07 14:02:56,262 DEBUG [RS:1;jenkins-hbase4:42681] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:02:56,262 INFO [RS:1;jenkins-hbase4:42681] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:02:56,262 INFO [RS:1;jenkins-hbase4:42681] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 14:02:56,262 INFO [RS:1;jenkins-hbase4:42681] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:02:56,263 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:02:56,263 INFO [RS:1;jenkins-hbase4:42681] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:02:56,264 INFO [RS:1;jenkins-hbase4:42681] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:02:56,265 INFO [RS:1;jenkins-hbase4:42681] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42681 2023-02-07 14:02:56,270 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/WALs/jenkins-hbase4.apache.org,35817,1675778562952/jenkins-hbase4.apache.org%2C35817%2C1675778562952.1675778565486 not finished, retry = 0 2023-02-07 14:02:56,272 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:02:56,272 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:56,272 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42681,1675778562998 2023-02-07 14:02:56,272 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:02:56,272 ERROR [Listener at localhost/40837-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25931e40 rejected from java.util.concurrent.ThreadPoolExecutor@21ac9e2a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:02:56,272 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:02:56,272 ERROR [Listener at localhost/40837-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@685cc391 rejected from java.util.concurrent.ThreadPoolExecutor@21ac9e2a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:02:56,272 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42681,1675778562998] 2023-02-07 14:02:56,272 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42681,1675778562998; numProcessing=1 2023-02-07 14:02:56,275 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42681,1675778562998 already deleted, retry=false 2023-02-07 14:02:56,275 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42681,1675778562998 expired; onlineServers=1 2023-02-07 14:02:56,373 DEBUG [RS:0;jenkins-hbase4:35817] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/oldWALs 2023-02-07 14:02:56,374 INFO [RS:0;jenkins-hbase4:35817] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35817%2C1675778562952:(num 1675778565486) 2023-02-07 14:02:56,374 DEBUG [RS:0;jenkins-hbase4:35817] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:02:56,374 INFO [RS:0;jenkins-hbase4:35817] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:02:56,374 INFO [RS:0;jenkins-hbase4:35817] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 14:02:56,375 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:02:56,376 INFO [RS:0;jenkins-hbase4:35817] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35817 2023-02-07 14:02:56,378 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:02:56,379 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35817,1675778562952 2023-02-07 14:02:56,379 ERROR [Listener at localhost/40837-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14193d45 rejected from java.util.concurrent.ThreadPoolExecutor@1026bb1e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:02:56,380 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35817,1675778562952] 2023-02-07 14:02:56,380 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35817,1675778562952; numProcessing=2 2023-02-07 14:02:56,381 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35817,1675778562952 already deleted, retry=false 2023-02-07 14:02:56,381 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35817,1675778562952 expired; onlineServers=0 2023-02-07 14:02:56,381 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39545,1675778561731' ***** 2023-02-07 14:02:56,381 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 14:02:56,382 DEBUG [M:0;jenkins-hbase4:39545] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fdf5068, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:02:56,382 INFO [M:0;jenkins-hbase4:39545] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39545,1675778561731 2023-02-07 14:02:56,382 INFO [M:0;jenkins-hbase4:39545] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39545,1675778561731; all regions closed. 2023-02-07 14:02:56,382 DEBUG [M:0;jenkins-hbase4:39545] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:02:56,382 DEBUG [M:0;jenkins-hbase4:39545] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 14:02:56,382 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 14:02:56,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778564240] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778564240,5,FailOnTimeoutGroup] 2023-02-07 14:02:56,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778564240] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778564240,5,FailOnTimeoutGroup] 2023-02-07 14:02:56,382 DEBUG [M:0;jenkins-hbase4:39545] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 14:02:56,384 INFO [M:0;jenkins-hbase4:39545] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 14:02:56,384 INFO [M:0;jenkins-hbase4:39545] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 14:02:56,384 INFO [M:0;jenkins-hbase4:39545] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 14:02:56,385 DEBUG [M:0;jenkins-hbase4:39545] master.HMaster(1502): Stopping service threads 2023-02-07 14:02:56,385 INFO [M:0;jenkins-hbase4:39545] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 14:02:56,385 ERROR [M:0;jenkins-hbase4:39545] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-07 14:02:56,386 INFO [M:0;jenkins-hbase4:39545] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 14:02:56,386 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 14:02:56,386 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:56,386 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 14:02:56,386 DEBUG [M:0;jenkins-hbase4:39545] zookeeper.ZKUtil(398): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 14:02:56,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:02:56,387 WARN [M:0;jenkins-hbase4:39545] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 14:02:56,387 INFO [M:0;jenkins-hbase4:39545] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 14:02:56,387 INFO [M:0;jenkins-hbase4:39545] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 14:02:56,388 DEBUG [M:0;jenkins-hbase4:39545] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:02:56,388 INFO [M:0;jenkins-hbase4:39545] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:02:56,388 DEBUG [M:0;jenkins-hbase4:39545] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:02:56,388 DEBUG [M:0;jenkins-hbase4:39545] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:02:56,388 DEBUG [M:0;jenkins-hbase4:39545] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:02:56,388 INFO [M:0;jenkins-hbase4:39545] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.26 KB heapSize=192.19 KB 2023-02-07 14:02:56,409 INFO [M:0;jenkins-hbase4:39545] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.26 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/900069e73f3a475e95132f8d074c3dfd 2023-02-07 14:02:56,415 DEBUG [M:0;jenkins-hbase4:39545] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/900069e73f3a475e95132f8d074c3dfd as hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/900069e73f3a475e95132f8d074c3dfd 2023-02-07 14:02:56,420 INFO [M:0;jenkins-hbase4:39545] regionserver.HStore(1080): Added hdfs://localhost:37673/user/jenkins/test-data/f442061d-2a04-cb1d-24a3-ef8e4890880d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/900069e73f3a475e95132f8d074c3dfd, entries=53, sequenceid=357, filesize=10.4 K 2023-02-07 14:02:56,421 INFO [M:0;jenkins-hbase4:39545] regionserver.HRegion(2947): Finished flush of dataSize ~159.26 KB/163083, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 33ms, sequenceid=357, compaction requested=false 2023-02-07 14:02:56,424 INFO [M:0;jenkins-hbase4:39545] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:02:56,424 DEBUG [M:0;jenkins-hbase4:39545] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778576387Disabling compacts and flushes for region at 1675778576387Disabling writes for close at 1675778576388 (+1 ms)Obtaining lock to block concurrent updates at 1675778576388Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675778576388Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163083, getHeapSize=196784, getOffHeapSize=0, getCellsCount=442 at 1675778576388Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675778576389 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675778576389Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675778576394 (+5 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675778576394Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675778576416 (+22 ms)Finished flush of dataSize ~159.26 KB/163083, heapSize ~192.17 KB/196784, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 33ms, sequenceid=357, compaction requested=false at 1675778576421 (+5 ms)Writing region close event to WAL at 1675778576424 (+3 ms)Closed at 1675778576424 2023-02-07 14:02:56,428 INFO [M:0;jenkins-hbase4:39545] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 14:02:56,428 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:02:56,429 INFO [M:0;jenkins-hbase4:39545] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39545 2023-02-07 14:02:56,431 DEBUG [M:0;jenkins-hbase4:39545] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39545,1675778561731 already deleted, retry=false 2023-02-07 14:02:56,545 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:02:56,545 INFO [M:0;jenkins-hbase4:39545] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39545,1675778561731; zookeeper connection closed. 2023-02-07 14:02:56,545 ERROR [Listener at localhost/40837-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@142a32ad rejected from java.util.concurrent.ThreadPoolExecutor@4909c91b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:02:56,545 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): master:39545-0x1002f177d090000, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:02:56,545 ERROR [Listener at localhost/40837-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10311cb2 rejected from java.util.concurrent.ThreadPoolExecutor@4909c91b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:02:56,645 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:02:56,645 ERROR [Listener at localhost/40837-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3915c014 rejected from java.util.concurrent.ThreadPoolExecutor@1026bb1e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:02:56,645 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:35817-0x1002f177d090001, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:02:56,645 ERROR [Listener at localhost/40837-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@41e088b4 rejected from java.util.concurrent.ThreadPoolExecutor@1026bb1e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:02:56,646 INFO [RS:0;jenkins-hbase4:35817] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35817,1675778562952; zookeeper connection closed. 2023-02-07 14:02:56,647 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@73b0d95c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@73b0d95c 2023-02-07 14:02:56,745 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:02:56,745 INFO [RS:1;jenkins-hbase4:42681] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42681,1675778562998; zookeeper connection closed. 2023-02-07 14:02:56,745 ERROR [Listener at localhost/40837-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@10983890 rejected from java.util.concurrent.ThreadPoolExecutor@21ac9e2a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:02:56,746 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@58453849] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@58453849 2023-02-07 14:02:56,746 DEBUG [Listener at localhost/40837-EventThread] zookeeper.ZKWatcher(600): regionserver:42681-0x1002f177d090002, quorum=127.0.0.1:55354, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:02:56,746 ERROR [Listener at localhost/40837-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a4ff07e rejected from java.util.concurrent.ThreadPoolExecutor@21ac9e2a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:02:56,746 INFO [Listener at localhost/40837] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 14:02:56,747 WARN [Listener at localhost/40837] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:02:56,751 INFO [Listener at localhost/40837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:02:56,856 WARN [BP-1611603536-172.31.14.131-1675778558083 heartbeating to localhost/127.0.0.1:37673] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 14:02:56,856 WARN [BP-1611603536-172.31.14.131-1675778558083 heartbeating to localhost/127.0.0.1:37673] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1611603536-172.31.14.131-1675778558083 (Datanode Uuid 1a9472a0-e162-4184-a883-c1412cebad94) service to localhost/127.0.0.1:37673 2023-02-07 14:02:56,858 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/cluster_a7113403-731d-7c1f-c69d-a97757e704e9/dfs/data/data3/current/BP-1611603536-172.31.14.131-1675778558083] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:02:56,859 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/cluster_a7113403-731d-7c1f-c69d-a97757e704e9/dfs/data/data4/current/BP-1611603536-172.31.14.131-1675778558083] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:02:56,861 WARN [Listener at localhost/40837] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:02:56,865 INFO [Listener at localhost/40837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:02:56,968 WARN [BP-1611603536-172.31.14.131-1675778558083 heartbeating to localhost/127.0.0.1:37673] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 14:02:56,968 WARN [BP-1611603536-172.31.14.131-1675778558083 heartbeating to localhost/127.0.0.1:37673] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1611603536-172.31.14.131-1675778558083 (Datanode Uuid 35fbf38b-0cef-4f8b-920b-61a3c6a0b37f) service to localhost/127.0.0.1:37673 2023-02-07 14:02:56,969 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/cluster_a7113403-731d-7c1f-c69d-a97757e704e9/dfs/data/data1/current/BP-1611603536-172.31.14.131-1675778558083] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:02:56,969 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/cluster_a7113403-731d-7c1f-c69d-a97757e704e9/dfs/data/data2/current/BP-1611603536-172.31.14.131-1675778558083] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:02:57,014 INFO [Listener at localhost/40837] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:02:57,045 INFO [Listener at localhost/40837] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 14:02:57,123 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 14:02:57,140 INFO [Listener at localhost/40837] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39545,1675778561731)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:37673 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:37673 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:37673 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:37673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:37673 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:37673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:37673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@6d177744 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40837 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=538 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=277 (was 237) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=5680 (was 6767) 2023-02-07 14:02:57,196 INFO [Listener at localhost/40837] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=538, MaxFileDescriptor=60000, SystemLoadAverage=277, ProcessCount=166, AvailableMemoryMB=5680 2023-02-07 14:02:57,210 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/hadoop.log.dir so I do NOT create it in target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab 2023-02-07 14:02:57,210 WARN [Listener at localhost/40837] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 14:02:57,210 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/hadoop.tmp.dir so I do NOT create it in target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab 2023-02-07 14:02:57,210 WARN [Listener at localhost/40837] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c71e0bfe-bf11-765a-36b7-cbc037cf4dce/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 14:02:57,210 DEBUG [Listener at localhost/40837] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab 2023-02-07 14:02:57,211 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 14:02:57,211 INFO [Listener at localhost/40837] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/cluster_e48f5955-c744-2f89-e38a-b1af473ed45e, deleteOnExit=true 2023-02-07 14:02:57,211 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 14:02:57,211 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/test.cache.data in system properties and HBase conf 2023-02-07 14:02:57,211 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 14:02:57,211 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/hadoop.log.dir in system properties and HBase conf 2023-02-07 14:02:57,211 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 14:02:57,211 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 14:02:57,211 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 14:02:57,212 DEBUG [Listener at localhost/40837] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 14:02:57,212 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:02:57,212 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:02:57,212 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 14:02:57,212 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:02:57,212 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 14:02:57,212 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 14:02:57,212 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:02:57,213 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:02:57,213 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 14:02:57,213 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/nfs.dump.dir in system properties and HBase conf 2023-02-07 14:02:57,213 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/java.io.tmpdir in system properties and HBase conf 2023-02-07 14:02:57,213 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:02:57,213 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 14:02:57,213 INFO [Listener at localhost/40837] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 14:02:57,217 WARN [Listener at localhost/40837] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:02:57,217 WARN [Listener at localhost/40837] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:02:57,271 WARN [Listener at localhost/40837] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:02:57,274 INFO [Listener at localhost/40837] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:02:57,283 INFO [Listener at localhost/40837] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/java.io.tmpdir/Jetty_localhost_46427_hdfs____6vb3oh/webapp 2023-02-07 14:02:57,408 INFO [Listener at localhost/40837] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46427 2023-02-07 14:02:57,412 WARN [Listener at localhost/40837] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:02:57,413 WARN [Listener at localhost/40837] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:02:57,464 WARN [Listener at localhost/43565] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:02:57,478 WARN [Listener at localhost/43565] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:02:57,480 WARN [Listener at localhost/43565] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:02:57,482 INFO [Listener at localhost/43565] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:02:57,489 INFO [Listener at localhost/43565] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/java.io.tmpdir/Jetty_localhost_35901_datanode____q0m33z/webapp 2023-02-07 14:02:57,596 INFO [Listener at localhost/43565] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35901 2023-02-07 14:02:57,607 WARN [Listener at localhost/33615] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:02:57,633 WARN [Listener at localhost/33615] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:02:57,635 WARN [Listener at localhost/33615] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:02:57,636 INFO [Listener at localhost/33615] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:02:57,640 INFO [Listener at localhost/33615] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/java.io.tmpdir/Jetty_localhost_45479_datanode____.vjoazo/webapp 2023-02-07 14:02:57,762 INFO [Listener at localhost/33615] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45479 2023-02-07 14:02:57,763 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xffb33ce00d489162: Processing first storage report for DS-babb0997-8d31-41b9-8e98-84c046401930 from datanode a6f9cc03-dfeb-4719-983f-ff4a77b2347b 2023-02-07 14:02:57,764 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xffb33ce00d489162: from storage DS-babb0997-8d31-41b9-8e98-84c046401930 node DatanodeRegistration(127.0.0.1:38447, datanodeUuid=a6f9cc03-dfeb-4719-983f-ff4a77b2347b, infoPort=37233, infoSecurePort=0, ipcPort=33615, storageInfo=lv=-57;cid=testClusterID;nsid=250390880;c=1675778577220), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:02:57,764 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xffb33ce00d489162: Processing first storage report for DS-8bffada1-7fbf-42e5-9ad1-db9f7645f310 from datanode a6f9cc03-dfeb-4719-983f-ff4a77b2347b 2023-02-07 14:02:57,764 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xffb33ce00d489162: from storage DS-8bffada1-7fbf-42e5-9ad1-db9f7645f310 node DatanodeRegistration(127.0.0.1:38447, datanodeUuid=a6f9cc03-dfeb-4719-983f-ff4a77b2347b, infoPort=37233, infoSecurePort=0, ipcPort=33615, storageInfo=lv=-57;cid=testClusterID;nsid=250390880;c=1675778577220), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:02:57,775 WARN [Listener at localhost/44779] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:02:57,881 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa45872337df70814: Processing first storage report for DS-80f59229-b17e-4bd5-aabc-7589331ef179 from datanode 1e607a47-a81f-44c1-b30c-10186d589e86 2023-02-07 14:02:57,881 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa45872337df70814: from storage DS-80f59229-b17e-4bd5-aabc-7589331ef179 node DatanodeRegistration(127.0.0.1:34201, datanodeUuid=1e607a47-a81f-44c1-b30c-10186d589e86, infoPort=44307, infoSecurePort=0, ipcPort=44779, storageInfo=lv=-57;cid=testClusterID;nsid=250390880;c=1675778577220), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:02:57,881 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa45872337df70814: Processing first storage report for DS-80a1a716-9092-4c7b-bfc4-e6f5c03a0883 from datanode 1e607a47-a81f-44c1-b30c-10186d589e86 2023-02-07 14:02:57,881 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa45872337df70814: from storage DS-80a1a716-9092-4c7b-bfc4-e6f5c03a0883 node DatanodeRegistration(127.0.0.1:34201, datanodeUuid=1e607a47-a81f-44c1-b30c-10186d589e86, infoPort=44307, infoSecurePort=0, ipcPort=44779, storageInfo=lv=-57;cid=testClusterID;nsid=250390880;c=1675778577220), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:02:57,885 DEBUG [Listener at localhost/44779] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab 2023-02-07 14:02:57,896 INFO [Listener at localhost/44779] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/cluster_e48f5955-c744-2f89-e38a-b1af473ed45e/zookeeper_0, clientPort=49376, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/cluster_e48f5955-c744-2f89-e38a-b1af473ed45e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/cluster_e48f5955-c744-2f89-e38a-b1af473ed45e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 14:02:57,898 INFO [Listener at localhost/44779] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49376 2023-02-07 14:02:57,898 INFO [Listener at localhost/44779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:57,900 INFO [Listener at localhost/44779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:57,923 INFO [Listener at localhost/44779] util.FSUtils(479): Created version file at hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897 with version=8 2023-02-07 14:02:57,923 INFO [Listener at localhost/44779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:57,925 INFO [Listener at localhost/44779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:57,927 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/hbase-staging 2023-02-07 14:02:57,929 INFO [Listener at localhost/44779] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:02:57,929 INFO [Listener at localhost/44779] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:57,929 INFO [Listener at localhost/44779] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:57,929 INFO [Listener at localhost/44779] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:02:57,930 INFO [Listener at localhost/44779] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:57,930 INFO [Listener at localhost/44779] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:02:57,930 INFO [Listener at localhost/44779] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:02:57,932 INFO [Listener at localhost/44779] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42615 2023-02-07 14:02:57,933 INFO [Listener at localhost/44779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:57,934 INFO [Listener at localhost/44779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:57,935 INFO [Listener at localhost/44779] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42615 connecting to ZooKeeper ensemble=127.0.0.1:49376 2023-02-07 14:02:57,957 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:426150x0, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:02:57,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42615-0x1002f17bfaa0000 connected 2023-02-07 14:02:57,999 DEBUG [Listener at localhost/44779] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:02:57,999 DEBUG [Listener at localhost/44779] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:02:58,000 DEBUG [Listener at localhost/44779] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:02:58,008 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42615 2023-02-07 14:02:58,008 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42615 2023-02-07 14:02:58,012 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42615 2023-02-07 14:02:58,016 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42615 2023-02-07 14:02:58,020 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42615 2023-02-07 14:02:58,020 INFO [Listener at localhost/44779] master.HMaster(439): hbase.rootdir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897, hbase.cluster.distributed=false 2023-02-07 14:02:58,037 INFO [Listener at localhost/44779] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:02:58,038 INFO [Listener at localhost/44779] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:58,038 INFO [Listener at localhost/44779] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:58,038 INFO [Listener at localhost/44779] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:02:58,038 INFO [Listener at localhost/44779] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:58,038 INFO [Listener at localhost/44779] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:02:58,038 INFO [Listener at localhost/44779] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:02:58,042 INFO [Listener at localhost/44779] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38051 2023-02-07 14:02:58,043 INFO [Listener at localhost/44779] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:02:58,050 DEBUG [Listener at localhost/44779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:58,050 INFO [Listener at localhost/44779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:58,052 INFO [Listener at localhost/44779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:58,053 INFO [Listener at localhost/44779] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38051 connecting to ZooKeeper ensemble=127.0.0.1:49376 2023-02-07 14:02:58,059 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:380510x0, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:02:58,060 DEBUG [Listener at localhost/44779] zookeeper.ZKUtil(164): regionserver:380510x0, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:02:58,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38051-0x1002f17bfaa0001 connected 2023-02-07 14:02:58,062 DEBUG [Listener at localhost/44779] zookeeper.ZKUtil(164): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:02:58,062 DEBUG [Listener at localhost/44779] zookeeper.ZKUtil(164): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:02:58,064 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38051 2023-02-07 14:02:58,064 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38051 2023-02-07 14:02:58,064 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38051 2023-02-07 14:02:58,068 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38051 2023-02-07 14:02:58,072 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38051 2023-02-07 14:02:58,091 INFO [Listener at localhost/44779] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:02:58,091 INFO [Listener at localhost/44779] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:58,091 INFO [Listener at localhost/44779] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:58,092 INFO [Listener at localhost/44779] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:02:58,092 INFO [Listener at localhost/44779] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:02:58,092 INFO [Listener at localhost/44779] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:02:58,092 INFO [Listener at localhost/44779] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:02:58,094 INFO [Listener at localhost/44779] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39143 2023-02-07 14:02:58,095 INFO [Listener at localhost/44779] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:02:58,104 DEBUG [Listener at localhost/44779] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:02:58,105 INFO [Listener at localhost/44779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:58,106 INFO [Listener at localhost/44779] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:58,107 INFO [Listener at localhost/44779] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39143 connecting to ZooKeeper ensemble=127.0.0.1:49376 2023-02-07 14:02:58,113 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:391430x0, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:02:58,115 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39143-0x1002f17bfaa0002 connected 2023-02-07 14:02:58,115 DEBUG [Listener at localhost/44779] zookeeper.ZKUtil(164): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:02:58,116 DEBUG [Listener at localhost/44779] zookeeper.ZKUtil(164): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:02:58,116 DEBUG [Listener at localhost/44779] zookeeper.ZKUtil(164): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:02:58,120 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39143 2023-02-07 14:02:58,124 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39143 2023-02-07 14:02:58,124 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39143 2023-02-07 14:02:58,128 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39143 2023-02-07 14:02:58,128 DEBUG [Listener at localhost/44779] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39143 2023-02-07 14:02:58,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42615,1675778577928 2023-02-07 14:02:58,132 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:02:58,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42615,1675778577928 2023-02-07 14:02:58,138 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:02:58,138 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:02:58,138 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:58,138 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:02:58,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:02:58,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42615,1675778577928 from backup master directory 2023-02-07 14:02:58,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:02:58,144 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:02:58,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,42615,1675778577928 2023-02-07 14:02:58,144 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42615,1675778577928 2023-02-07 14:02:58,144 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:02:58,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/hbase.id with ID: 1727d11e-b7fa-431f-847b-f4818140b27a 2023-02-07 14:02:58,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:02:58,190 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:58,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x66fa99d5 to 127.0.0.1:49376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:02:58,210 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60fb0518, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:02:58,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:02:58,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 14:02:58,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:02:58,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/MasterData/data/master/store-tmp 2023-02-07 14:02:58,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:58,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:02:58,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:02:58,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:02:58,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:02:58,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:02:58,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:02:58,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778578225Disabling compacts and flushes for region at 1675778578225Disabling writes for close at 1675778578225Writing region close event to WAL at 1675778578225Closed at 1675778578225 2023-02-07 14:02:58,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/MasterData/WALs/jenkins-hbase4.apache.org,42615,1675778577928 2023-02-07 14:02:58,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42615%2C1675778577928, suffix=, logDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/MasterData/WALs/jenkins-hbase4.apache.org,42615,1675778577928, archiveDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/MasterData/oldWALs, maxLogs=10 2023-02-07 14:02:58,250 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38447,DS-babb0997-8d31-41b9-8e98-84c046401930,DISK] 2023-02-07 14:02:58,251 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34201,DS-80f59229-b17e-4bd5-aabc-7589331ef179,DISK] 2023-02-07 14:02:58,260 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/MasterData/WALs/jenkins-hbase4.apache.org,42615,1675778577928/jenkins-hbase4.apache.org%2C42615%2C1675778577928.1675778578229 2023-02-07 14:02:58,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38447,DS-babb0997-8d31-41b9-8e98-84c046401930,DISK], DatanodeInfoWithStorage[127.0.0.1:34201,DS-80f59229-b17e-4bd5-aabc-7589331ef179,DISK]] 2023-02-07 14:02:58,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:02:58,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:58,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:02:58,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:02:58,268 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:02:58,270 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 14:02:58,270 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 14:02:58,271 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:58,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:02:58,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:02:58,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:02:58,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:58,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58940665, jitterRate=-0.12171564996242523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:02:58,278 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675778578261Initializing all the Stores at 1675778578262 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778578262Cleaning up temporary data from old regions at 1675778578273 (+11 ms)Cleaning up detritus from prior splits at 1675778578273Region opened successfully at 1675778578278 (+5 ms) 2023-02-07 14:02:58,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 14:02:58,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 14:02:58,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 14:02:58,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 14:02:58,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 14:02:58,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 14:02:58,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 14:02:58,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 14:02:58,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 14:02:58,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 14:02:58,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 14:02:58,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 14:02:58,302 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 14:02:58,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 14:02:58,305 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:58,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 14:02:58,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 14:02:58,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 14:02:58,308 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:02:58,308 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:02:58,308 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:02:58,308 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:58,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,42615,1675778577928, sessionid=0x1002f17bfaa0000, setting cluster-up flag (Was=false) 2023-02-07 14:02:58,314 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:58,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 14:02:58,319 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42615,1675778577928 2023-02-07 14:02:58,323 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:58,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 14:02:58,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42615,1675778577928 2023-02-07 14:02:58,330 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.hbase-snapshot/.tmp 2023-02-07 14:02:58,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 14:02:58,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:02:58,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:02:58,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:02:58,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:02:58,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 14:02:58,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:02:58,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675778608351 2023-02-07 14:02:58,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 14:02:58,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 14:02:58,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 14:02:58,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 14:02:58,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 14:02:58,352 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 14:02:58,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 14:02:58,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 14:02:58,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 14:02:58,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 14:02:58,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 14:02:58,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778578358,5,FailOnTimeoutGroup] 2023-02-07 14:02:58,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778578358,5,FailOnTimeoutGroup] 2023-02-07 14:02:58,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 14:02:58,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,359 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:02:58,359 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 14:02:58,361 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:02:58,394 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:02:58,395 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:02:58,395 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897 2023-02-07 14:02:58,407 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:58,409 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:02:58,410 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/info 2023-02-07 14:02:58,411 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:02:58,412 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:58,412 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:02:58,416 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:02:58,416 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:02:58,417 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:58,417 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:02:58,418 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/table 2023-02-07 14:02:58,419 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:02:58,419 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:58,420 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740 2023-02-07 14:02:58,420 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740 2023-02-07 14:02:58,422 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:02:58,424 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:02:58,426 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:58,426 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73470985, jitterRate=0.09480299055576324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:02:58,426 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675778578407Initializing all the Stores at 1675778578408 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778578408Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778578408Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778578408Cleaning up temporary data from old regions at 1675778578421 (+13 ms)Cleaning up detritus from prior splits at 1675778578422 (+1 ms)Region opened successfully at 1675778578426 (+4 ms) 2023-02-07 14:02:58,427 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:02:58,427 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:02:58,427 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:02:58,427 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:02:58,427 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:02:58,427 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:02:58,427 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778578427Disabling compacts and flushes for region at 1675778578427Disabling writes for close at 1675778578427Writing region close event to WAL at 1675778578427Closed at 1675778578427 2023-02-07 14:02:58,428 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:02:58,428 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 14:02:58,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 14:02:58,431 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 14:02:58,432 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(952): ClusterId : 1727d11e-b7fa-431f-847b-f4818140b27a 2023-02-07 14:02:58,432 DEBUG [RS:0;jenkins-hbase4:38051] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:02:58,435 DEBUG [RS:0;jenkins-hbase4:38051] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:02:58,435 DEBUG [RS:0;jenkins-hbase4:38051] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:02:58,437 DEBUG [RS:0;jenkins-hbase4:38051] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:02:58,440 DEBUG [RS:0;jenkins-hbase4:38051] zookeeper.ReadOnlyZKClient(139): Connect 0x7d97dda9 to 127.0.0.1:49376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:02:58,440 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(952): ClusterId : 1727d11e-b7fa-431f-847b-f4818140b27a 2023-02-07 14:02:58,440 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 14:02:58,440 DEBUG [RS:1;jenkins-hbase4:39143] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:02:58,443 DEBUG [RS:1;jenkins-hbase4:39143] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:02:58,443 DEBUG [RS:1;jenkins-hbase4:39143] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:02:58,445 DEBUG [RS:1;jenkins-hbase4:39143] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:02:58,457 DEBUG [RS:1;jenkins-hbase4:39143] zookeeper.ReadOnlyZKClient(139): Connect 0x6313eba3 to 127.0.0.1:49376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:02:58,465 DEBUG [RS:0;jenkins-hbase4:38051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73502c6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:02:58,465 DEBUG [RS:0;jenkins-hbase4:38051] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@776fb6d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:02:58,467 DEBUG [RS:1;jenkins-hbase4:39143] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dd409b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:02:58,468 DEBUG [RS:1;jenkins-hbase4:39143] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69eb80d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:02:58,480 DEBUG [RS:0;jenkins-hbase4:38051] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38051 2023-02-07 14:02:58,480 INFO [RS:0;jenkins-hbase4:38051] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:02:58,480 INFO [RS:0;jenkins-hbase4:38051] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:02:58,480 DEBUG [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:02:58,481 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42615,1675778577928 with isa=jenkins-hbase4.apache.org/172.31.14.131:38051, startcode=1675778578037 2023-02-07 14:02:58,481 DEBUG [RS:0;jenkins-hbase4:38051] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:02:58,483 DEBUG [RS:1;jenkins-hbase4:39143] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39143 2023-02-07 14:02:58,483 INFO [RS:1;jenkins-hbase4:39143] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:02:58,483 INFO [RS:1;jenkins-hbase4:39143] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:02:58,483 DEBUG [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:02:58,484 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42615,1675778577928 with isa=jenkins-hbase4.apache.org/172.31.14.131:39143, startcode=1675778578090 2023-02-07 14:02:58,484 DEBUG [RS:1;jenkins-hbase4:39143] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:02:58,493 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33225, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:02:58,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:02:58,497 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47227, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:02:58,498 DEBUG [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897 2023-02-07 14:02:58,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:02:58,498 DEBUG [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43565 2023-02-07 14:02:58,498 DEBUG [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:02:58,499 DEBUG [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897 2023-02-07 14:02:58,499 DEBUG [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:43565 2023-02-07 14:02:58,499 DEBUG [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:02:58,500 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:02:58,504 DEBUG [RS:0;jenkins-hbase4:38051] zookeeper.ZKUtil(162): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:02:58,504 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39143,1675778578090] 2023-02-07 14:02:58,504 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38051,1675778578037] 2023-02-07 14:02:58,504 WARN [RS:0;jenkins-hbase4:38051] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:02:58,504 DEBUG [RS:1;jenkins-hbase4:39143] zookeeper.ZKUtil(162): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:02:58,504 INFO [RS:0;jenkins-hbase4:38051] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:02:58,504 WARN [RS:1;jenkins-hbase4:39143] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:02:58,504 DEBUG [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/WALs/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:02:58,505 INFO [RS:1;jenkins-hbase4:39143] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:02:58,505 DEBUG [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(1947): logDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/WALs/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:02:58,528 DEBUG [RS:1;jenkins-hbase4:39143] zookeeper.ZKUtil(162): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:02:58,529 DEBUG [RS:0;jenkins-hbase4:38051] zookeeper.ZKUtil(162): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:02:58,529 DEBUG [RS:1;jenkins-hbase4:39143] zookeeper.ZKUtil(162): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:02:58,529 DEBUG [RS:0;jenkins-hbase4:38051] zookeeper.ZKUtil(162): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:02:58,530 DEBUG [RS:1;jenkins-hbase4:39143] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:02:58,530 INFO [RS:1;jenkins-hbase4:39143] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:02:58,533 DEBUG [RS:0;jenkins-hbase4:38051] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:02:58,533 INFO [RS:0;jenkins-hbase4:38051] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:02:58,536 INFO [RS:1;jenkins-hbase4:39143] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:02:58,540 INFO [RS:0;jenkins-hbase4:38051] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:02:58,540 INFO [RS:1;jenkins-hbase4:39143] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:02:58,540 INFO [RS:1;jenkins-hbase4:39143] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,541 INFO [RS:0;jenkins-hbase4:38051] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:02:58,541 INFO [RS:0;jenkins-hbase4:38051] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,544 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:02:58,548 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:02:58,550 INFO [RS:1;jenkins-hbase4:39143] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,550 INFO [RS:0;jenkins-hbase4:38051] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,551 DEBUG [RS:1;jenkins-hbase4:39143] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,551 DEBUG [RS:0;jenkins-hbase4:38051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,551 DEBUG [RS:1;jenkins-hbase4:39143] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,551 DEBUG [RS:1;jenkins-hbase4:39143] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,551 DEBUG [RS:1;jenkins-hbase4:39143] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,551 DEBUG [RS:1;jenkins-hbase4:39143] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,551 DEBUG [RS:1;jenkins-hbase4:39143] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:02:58,551 DEBUG [RS:1;jenkins-hbase4:39143] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,551 DEBUG [RS:1;jenkins-hbase4:39143] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,551 DEBUG [RS:1;jenkins-hbase4:39143] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,551 DEBUG [RS:1;jenkins-hbase4:39143] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,551 DEBUG [RS:0;jenkins-hbase4:38051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,551 DEBUG [RS:0;jenkins-hbase4:38051] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,551 DEBUG [RS:0;jenkins-hbase4:38051] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,552 DEBUG [RS:0;jenkins-hbase4:38051] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,552 DEBUG [RS:0;jenkins-hbase4:38051] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:02:58,552 DEBUG [RS:0;jenkins-hbase4:38051] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,552 DEBUG [RS:0;jenkins-hbase4:38051] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,552 DEBUG [RS:0;jenkins-hbase4:38051] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,552 DEBUG [RS:0;jenkins-hbase4:38051] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:02:58,576 INFO [RS:0;jenkins-hbase4:38051] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,576 INFO [RS:1;jenkins-hbase4:39143] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,576 INFO [RS:0;jenkins-hbase4:38051] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,576 INFO [RS:1;jenkins-hbase4:39143] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,577 INFO [RS:0;jenkins-hbase4:38051] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,577 INFO [RS:1;jenkins-hbase4:39143] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,591 DEBUG [jenkins-hbase4:42615] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 14:02:58,591 DEBUG [jenkins-hbase4:42615] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:02:58,597 DEBUG [jenkins-hbase4:42615] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:02:58,597 DEBUG [jenkins-hbase4:42615] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:02:58,597 DEBUG [jenkins-hbase4:42615] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:02:58,598 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38051,1675778578037, state=OPENING 2023-02-07 14:02:58,599 INFO [RS:0;jenkins-hbase4:38051] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:02:58,599 INFO [RS:0;jenkins-hbase4:38051] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38051,1675778578037-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,600 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 14:02:58,606 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:58,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38051,1675778578037}] 2023-02-07 14:02:58,607 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:02:58,615 INFO [RS:1;jenkins-hbase4:39143] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:02:58,615 INFO [RS:1;jenkins-hbase4:39143] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39143,1675778578090-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,632 INFO [RS:0;jenkins-hbase4:38051] regionserver.Replication(203): jenkins-hbase4.apache.org,38051,1675778578037 started 2023-02-07 14:02:58,632 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38051,1675778578037, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38051, sessionid=0x1002f17bfaa0001 2023-02-07 14:02:58,632 DEBUG [RS:0;jenkins-hbase4:38051] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:02:58,632 DEBUG [RS:0;jenkins-hbase4:38051] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:02:58,632 DEBUG [RS:0;jenkins-hbase4:38051] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38051,1675778578037' 2023-02-07 14:02:58,632 DEBUG [RS:0;jenkins-hbase4:38051] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:02:58,633 DEBUG [RS:0;jenkins-hbase4:38051] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:02:58,633 DEBUG [RS:0;jenkins-hbase4:38051] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:02:58,633 DEBUG [RS:0;jenkins-hbase4:38051] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:02:58,633 DEBUG [RS:0;jenkins-hbase4:38051] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:02:58,633 DEBUG [RS:0;jenkins-hbase4:38051] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38051,1675778578037' 2023-02-07 14:02:58,634 DEBUG [RS:0;jenkins-hbase4:38051] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:02:58,634 DEBUG [RS:0;jenkins-hbase4:38051] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:02:58,634 DEBUG [RS:0;jenkins-hbase4:38051] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:02:58,634 INFO [RS:0;jenkins-hbase4:38051] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:02:58,634 INFO [RS:0;jenkins-hbase4:38051] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:02:58,640 INFO [RS:1;jenkins-hbase4:39143] regionserver.Replication(203): jenkins-hbase4.apache.org,39143,1675778578090 started 2023-02-07 14:02:58,640 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39143,1675778578090, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39143, sessionid=0x1002f17bfaa0002 2023-02-07 14:02:58,640 DEBUG [RS:1;jenkins-hbase4:39143] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:02:58,640 DEBUG [RS:1;jenkins-hbase4:39143] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:02:58,640 DEBUG [RS:1;jenkins-hbase4:39143] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39143,1675778578090' 2023-02-07 14:02:58,640 DEBUG [RS:1;jenkins-hbase4:39143] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:02:58,641 DEBUG [RS:1;jenkins-hbase4:39143] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:02:58,642 DEBUG [RS:1;jenkins-hbase4:39143] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:02:58,642 DEBUG [RS:1;jenkins-hbase4:39143] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:02:58,642 DEBUG [RS:1;jenkins-hbase4:39143] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:02:58,642 DEBUG [RS:1;jenkins-hbase4:39143] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39143,1675778578090' 2023-02-07 14:02:58,642 DEBUG [RS:1;jenkins-hbase4:39143] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:02:58,642 DEBUG [RS:1;jenkins-hbase4:39143] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:02:58,643 DEBUG [RS:1;jenkins-hbase4:39143] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:02:58,643 INFO [RS:1;jenkins-hbase4:39143] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:02:58,643 INFO [RS:1;jenkins-hbase4:39143] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:02:58,766 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:02:58,766 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 14:02:58,769 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45094, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 14:02:58,774 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 14:02:58,774 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:02:58,776 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38051%2C1675778578037.meta, suffix=.meta, logDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/WALs/jenkins-hbase4.apache.org,38051,1675778578037, archiveDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/oldWALs, maxLogs=32 2023-02-07 14:02:58,795 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38447,DS-babb0997-8d31-41b9-8e98-84c046401930,DISK] 2023-02-07 14:02:58,797 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34201,DS-80f59229-b17e-4bd5-aabc-7589331ef179,DISK] 2023-02-07 14:02:58,800 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/WALs/jenkins-hbase4.apache.org,38051,1675778578037/jenkins-hbase4.apache.org%2C38051%2C1675778578037.meta.1675778578778.meta 2023-02-07 14:02:58,800 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38447,DS-babb0997-8d31-41b9-8e98-84c046401930,DISK], DatanodeInfoWithStorage[127.0.0.1:34201,DS-80f59229-b17e-4bd5-aabc-7589331ef179,DISK]] 2023-02-07 14:02:58,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:02:58,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 14:02:58,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 14:02:58,802 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 14:02:58,803 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 14:02:58,803 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:58,803 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 14:02:58,803 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 14:02:58,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:02:58,806 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/info 2023-02-07 14:02:58,806 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/info 2023-02-07 14:02:58,807 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:02:58,807 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:58,807 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:02:58,809 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:02:58,809 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:02:58,809 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:02:58,810 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:58,810 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:02:58,811 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/table 2023-02-07 14:02:58,811 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/table 2023-02-07 14:02:58,811 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:02:58,812 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:58,812 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740 2023-02-07 14:02:58,814 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740 2023-02-07 14:02:58,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:02:58,818 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:02:58,819 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63542042, jitterRate=-0.053149789571762085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:02:58,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675778578803Writing region info on filesystem at 1675778578803Initializing all the Stores at 1675778578805 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778578805Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778578805Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778578805Cleaning up temporary data from old regions at 1675778578815 (+10 ms)Cleaning up detritus from prior splits at 1675778578816 (+1 ms)Running coprocessor post-open hooks at 1675778578819 (+3 ms)Region opened successfully at 1675778578819 2023-02-07 14:02:58,820 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675778578766 2023-02-07 14:02:58,825 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 14:02:58,826 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 14:02:58,827 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38051,1675778578037, state=OPEN 2023-02-07 14:02:58,828 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 14:02:58,828 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:02:58,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 14:02:58,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38051,1675778578037 in 221 msec 2023-02-07 14:02:58,833 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 14:02:58,834 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 403 msec 2023-02-07 14:02:58,835 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 503 msec 2023-02-07 14:02:58,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675778578137, completionTime=-1 2023-02-07 14:02:58,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 14:02:58,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 14:02:58,842 DEBUG [hconnection-0x42abd090-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:02:58,845 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45102, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:02:58,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 14:02:58,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675778638847 2023-02-07 14:02:58,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675778698847 2023-02-07 14:02:58,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 11 msec 2023-02-07 14:02:58,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42615,1675778577928-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42615,1675778577928-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42615,1675778577928-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42615, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 14:02:58,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 14:02:58,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:02:58,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 14:02:58,860 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 14:02:58,860 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:02:58,861 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:02:58,863 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/hbase/namespace/010ec1a2aee7eda29fe7a0a57e2efffd 2023-02-07 14:02:58,864 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/hbase/namespace/010ec1a2aee7eda29fe7a0a57e2efffd empty. 2023-02-07 14:02:58,865 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/hbase/namespace/010ec1a2aee7eda29fe7a0a57e2efffd 2023-02-07 14:02:58,865 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 14:02:58,884 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 14:02:58,886 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 010ec1a2aee7eda29fe7a0a57e2efffd, NAME => 'hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp 2023-02-07 14:02:58,899 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:58,899 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 010ec1a2aee7eda29fe7a0a57e2efffd, disabling compactions & flushes 2023-02-07 14:02:58,899 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. 2023-02-07 14:02:58,899 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. 2023-02-07 14:02:58,899 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. after waiting 0 ms 2023-02-07 14:02:58,899 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. 2023-02-07 14:02:58,899 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. 2023-02-07 14:02:58,899 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 010ec1a2aee7eda29fe7a0a57e2efffd: Waiting for close lock at 1675778578899Disabling compacts and flushes for region at 1675778578899Disabling writes for close at 1675778578899Writing region close event to WAL at 1675778578899Closed at 1675778578899 2023-02-07 14:02:58,902 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:02:58,903 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778578903"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778578903"}]},"ts":"1675778578903"} 2023-02-07 14:02:58,906 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 14:02:58,907 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:02:58,907 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778578907"}]},"ts":"1675778578907"} 2023-02-07 14:02:58,909 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 14:02:58,913 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:02:58,914 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:02:58,914 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:02:58,914 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:02:58,914 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=010ec1a2aee7eda29fe7a0a57e2efffd, ASSIGN}] 2023-02-07 14:02:58,917 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=010ec1a2aee7eda29fe7a0a57e2efffd, ASSIGN 2023-02-07 14:02:58,918 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=010ec1a2aee7eda29fe7a0a57e2efffd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39143,1675778578090; forceNewPlan=false, retain=false 2023-02-07 14:02:59,068 INFO [jenkins-hbase4:42615] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 14:02:59,069 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=010ec1a2aee7eda29fe7a0a57e2efffd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:02:59,070 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778579069"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778579069"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778579069"}]},"ts":"1675778579069"} 2023-02-07 14:02:59,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 010ec1a2aee7eda29fe7a0a57e2efffd, server=jenkins-hbase4.apache.org,39143,1675778578090}] 2023-02-07 14:02:59,225 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:02:59,225 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 14:02:59,228 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52800, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 14:02:59,233 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. 2023-02-07 14:02:59,235 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39143%2C1675778578090, suffix=, logDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/WALs/jenkins-hbase4.apache.org,39143,1675778578090, archiveDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/oldWALs, maxLogs=32 2023-02-07 14:02:59,257 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38447,DS-babb0997-8d31-41b9-8e98-84c046401930,DISK] 2023-02-07 14:02:59,257 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34201,DS-80f59229-b17e-4bd5-aabc-7589331ef179,DISK] 2023-02-07 14:02:59,272 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/WALs/jenkins-hbase4.apache.org,39143,1675778578090/jenkins-hbase4.apache.org%2C39143%2C1675778578090.1675778579236 2023-02-07 14:02:59,272 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38447,DS-babb0997-8d31-41b9-8e98-84c046401930,DISK], DatanodeInfoWithStorage[127.0.0.1:34201,DS-80f59229-b17e-4bd5-aabc-7589331ef179,DISK]] 2023-02-07 14:02:59,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 010ec1a2aee7eda29fe7a0a57e2efffd, NAME => 'hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:02:59,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 010ec1a2aee7eda29fe7a0a57e2efffd 2023-02-07 14:02:59,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:59,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 010ec1a2aee7eda29fe7a0a57e2efffd 2023-02-07 14:02:59,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 010ec1a2aee7eda29fe7a0a57e2efffd 2023-02-07 14:02:59,276 INFO [StoreOpener-010ec1a2aee7eda29fe7a0a57e2efffd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 010ec1a2aee7eda29fe7a0a57e2efffd 2023-02-07 14:02:59,278 DEBUG [StoreOpener-010ec1a2aee7eda29fe7a0a57e2efffd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/namespace/010ec1a2aee7eda29fe7a0a57e2efffd/info 2023-02-07 14:02:59,278 DEBUG [StoreOpener-010ec1a2aee7eda29fe7a0a57e2efffd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/namespace/010ec1a2aee7eda29fe7a0a57e2efffd/info 2023-02-07 14:02:59,278 INFO [StoreOpener-010ec1a2aee7eda29fe7a0a57e2efffd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 010ec1a2aee7eda29fe7a0a57e2efffd columnFamilyName info 2023-02-07 14:02:59,279 INFO [StoreOpener-010ec1a2aee7eda29fe7a0a57e2efffd-1] regionserver.HStore(310): Store=010ec1a2aee7eda29fe7a0a57e2efffd/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:02:59,279 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/namespace/010ec1a2aee7eda29fe7a0a57e2efffd 2023-02-07 14:02:59,280 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/namespace/010ec1a2aee7eda29fe7a0a57e2efffd 2023-02-07 14:02:59,283 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 010ec1a2aee7eda29fe7a0a57e2efffd 2023-02-07 14:02:59,285 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/namespace/010ec1a2aee7eda29fe7a0a57e2efffd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:02:59,286 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 010ec1a2aee7eda29fe7a0a57e2efffd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73947284, jitterRate=0.10190039873123169}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:02:59,286 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 010ec1a2aee7eda29fe7a0a57e2efffd: Running coprocessor pre-open hook at 1675778579273Writing region info on filesystem at 1675778579273Initializing all the Stores at 1675778579274 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778579275 (+1 ms)Cleaning up temporary data from old regions at 1675778579281 (+6 ms)Cleaning up detritus from prior splits at 1675778579281Running coprocessor post-open hooks at 1675778579286 (+5 ms)Region opened successfully at 1675778579286 2023-02-07 14:02:59,286 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd., pid=6, masterSystemTime=1675778579225 2023-02-07 14:02:59,292 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. 2023-02-07 14:02:59,292 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. 2023-02-07 14:02:59,293 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=010ec1a2aee7eda29fe7a0a57e2efffd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:02:59,293 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778579292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778579292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778579292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778579292"}]},"ts":"1675778579292"} 2023-02-07 14:02:59,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 14:02:59,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 010ec1a2aee7eda29fe7a0a57e2efffd, server=jenkins-hbase4.apache.org,39143,1675778578090 in 223 msec 2023-02-07 14:02:59,310 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 14:02:59,310 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=010ec1a2aee7eda29fe7a0a57e2efffd, ASSIGN in 383 msec 2023-02-07 14:02:59,311 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:02:59,311 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778579311"}]},"ts":"1675778579311"} 2023-02-07 14:02:59,313 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 14:02:59,317 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:02:59,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 460 msec 2023-02-07 14:02:59,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 14:02:59,361 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:02:59,361 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:02:59,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:02:59,367 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52804, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:02:59,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 14:02:59,385 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:02:59,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 15 msec 2023-02-07 14:02:59,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 14:02:59,406 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:02:59,409 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-07 14:02:59,424 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 14:02:59,428 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 14:02:59,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.284sec 2023-02-07 14:02:59,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 14:02:59,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 14:02:59,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 14:02:59,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42615,1675778577928-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 14:02:59,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42615,1675778577928-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 14:02:59,431 DEBUG [Listener at localhost/44779] zookeeper.ReadOnlyZKClient(139): Connect 0x0b106ad8 to 127.0.0.1:49376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:02:59,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 14:02:59,450 DEBUG [Listener at localhost/44779] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cb82634, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:02:59,452 DEBUG [hconnection-0x56e0690c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:02:59,455 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45116, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:02:59,457 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42615,1675778577928 2023-02-07 14:02:59,457 DEBUG [Listener at localhost/44779] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 14:02:59,457 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:59,458 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:59,463 DEBUG [Listener at localhost/44779] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 14:02:59,467 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35776, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 14:02:59,468 INFO [Listener at localhost/44779] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 14:02:59,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-07 14:02:59,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 14:02:59,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:35776 deadline: 1675778639468, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-07 14:02:59,470 INFO [Listener at localhost/44779] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-07 14:02:59,470 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:59,470 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:59,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:02:59,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-07 14:02:59,489 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:02:59,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-07 14:02:59,489 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:59,489 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:59,490 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:02:59,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:02:59,499 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:02:59,499 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:02:59,499 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:02:59,500 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219 2023-02-07 14:02:59,500 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:02:59,500 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:02:59,500 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:02:59,500 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6 2023-02-07 14:02:59,500 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219 empty. 2023-02-07 14:02:59,500 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a empty. 2023-02-07 14:02:59,500 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13 empty. 2023-02-07 14:02:59,500 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/1d96f10cad3fa67966a23bb1d9a51d39 empty. 2023-02-07 14:02:59,500 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a empty. 2023-02-07 14:02:59,501 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6 empty. 2023-02-07 14:02:59,501 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219 2023-02-07 14:02:59,501 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:02:59,501 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6 empty. 2023-02-07 14:02:59,502 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2 empty. 2023-02-07 14:02:59,502 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf empty. 2023-02-07 14:02:59,502 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:02:59,502 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:02:59,502 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6 2023-02-07 14:02:59,502 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:02:59,502 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:02:59,502 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:02:59,502 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:02:59,503 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:02:59,503 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:02:59,503 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/8cec9d5f1cbe32deb3030b840075b733 empty. 2023-02-07 14:02:59,503 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:02:59,503 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 14:02:59,519 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-07 14:02:59,520 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1d96f10cad3fa67966a23bb1d9a51d39, NAME => 'testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp 2023-02-07 14:02:59,524 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => fbf5e715c5ad5096882efc3afdeb361a, NAME => 'testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp 2023-02-07 14:02:59,528 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 73d71a6e15eb7562eeb109ee3a9dbb13, NAME => 'testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp 2023-02-07 14:02:59,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:59,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 1d96f10cad3fa67966a23bb1d9a51d39, disabling compactions & flushes 2023-02-07 14:02:59,553 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:02:59,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:02:59,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. after waiting 0 ms 2023-02-07 14:02:59,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:02:59,553 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:02:59,553 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 1d96f10cad3fa67966a23bb1d9a51d39: Waiting for close lock at 1675778579553Disabling compacts and flushes for region at 1675778579553Disabling writes for close at 1675778579553Writing region close event to WAL at 1675778579553Closed at 1675778579553 2023-02-07 14:02:59,554 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b29449ae529fdca05cae653bea21a219, NAME => 'testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp 2023-02-07 14:02:59,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:59,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing fbf5e715c5ad5096882efc3afdeb361a, disabling compactions & flushes 2023-02-07 14:02:59,565 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:02:59,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:02:59,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. after waiting 0 ms 2023-02-07 14:02:59,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:02:59,565 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:02:59,565 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for fbf5e715c5ad5096882efc3afdeb361a: Waiting for close lock at 1675778579565Disabling compacts and flushes for region at 1675778579565Disabling writes for close at 1675778579565Writing region close event to WAL at 1675778579565Closed at 1675778579565 2023-02-07 14:02:59,566 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => b56d417a00b93a9a78fc601a14f3770a, NAME => 'testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp 2023-02-07 14:02:59,569 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:59,569 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 73d71a6e15eb7562eeb109ee3a9dbb13, disabling compactions & flushes 2023-02-07 14:02:59,569 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:02:59,569 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:02:59,569 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. after waiting 0 ms 2023-02-07 14:02:59,569 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:02:59,569 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:02:59,569 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 73d71a6e15eb7562eeb109ee3a9dbb13: Waiting for close lock at 1675778579569Disabling compacts and flushes for region at 1675778579569Disabling writes for close at 1675778579569Writing region close event to WAL at 1675778579569Closed at 1675778579569 2023-02-07 14:02:59,570 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => b8b3c36284ccb70b2e6cbad7c3742fd6, NAME => 'testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp 2023-02-07 14:02:59,578 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:59,578 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing b56d417a00b93a9a78fc601a14f3770a, disabling compactions & flushes 2023-02-07 14:02:59,578 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:02:59,578 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:02:59,578 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. after waiting 0 ms 2023-02-07 14:02:59,578 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:02:59,578 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:02:59,578 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for b56d417a00b93a9a78fc601a14f3770a: Waiting for close lock at 1675778579578Disabling compacts and flushes for region at 1675778579578Disabling writes for close at 1675778579578Writing region close event to WAL at 1675778579578Closed at 1675778579578 2023-02-07 14:02:59,579 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => c594c4d1559bf6f1b8483ad2ed4643c2, NAME => 'testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp 2023-02-07 14:02:59,582 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:59,582 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing b8b3c36284ccb70b2e6cbad7c3742fd6, disabling compactions & flushes 2023-02-07 14:02:59,582 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:02:59,582 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:02:59,582 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. after waiting 0 ms 2023-02-07 14:02:59,582 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:02:59,582 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:02:59,582 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for b8b3c36284ccb70b2e6cbad7c3742fd6: Waiting for close lock at 1675778579582Disabling compacts and flushes for region at 1675778579582Disabling writes for close at 1675778579582Writing region close event to WAL at 1675778579582Closed at 1675778579582 2023-02-07 14:02:59,583 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => e13b7676e6adda7db49592ff690641e6, NAME => 'testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp 2023-02-07 14:02:59,591 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:59,591 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:59,592 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:59,592 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing c594c4d1559bf6f1b8483ad2ed4643c2, disabling compactions & flushes 2023-02-07 14:02:59,592 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:02:59,592 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:02:59,592 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. after waiting 0 ms 2023-02-07 14:02:59,592 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:02:59,592 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:02:59,592 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for c594c4d1559bf6f1b8483ad2ed4643c2: Waiting for close lock at 1675778579592Disabling compacts and flushes for region at 1675778579592Disabling writes for close at 1675778579592Writing region close event to WAL at 1675778579592Closed at 1675778579592 2023-02-07 14:02:59,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:02:59,593 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => d72c5b2617af9d66aee7e9b65a3c57cf, NAME => 'testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp 2023-02-07 14:02:59,595 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:59,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing e13b7676e6adda7db49592ff690641e6, disabling compactions & flushes 2023-02-07 14:02:59,596 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:02:59,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:02:59,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. after waiting 0 ms 2023-02-07 14:02:59,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:02:59,596 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:02:59,596 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for e13b7676e6adda7db49592ff690641e6: Waiting for close lock at 1675778579596Disabling compacts and flushes for region at 1675778579596Disabling writes for close at 1675778579596Writing region close event to WAL at 1675778579596Closed at 1675778579596 2023-02-07 14:02:59,596 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8cec9d5f1cbe32deb3030b840075b733, NAME => 'testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.tmp 2023-02-07 14:02:59,603 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:59,603 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing d72c5b2617af9d66aee7e9b65a3c57cf, disabling compactions & flushes 2023-02-07 14:02:59,603 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:02:59,603 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:02:59,603 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. after waiting 0 ms 2023-02-07 14:02:59,603 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:02:59,603 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:02:59,603 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for d72c5b2617af9d66aee7e9b65a3c57cf: Waiting for close lock at 1675778579603Disabling compacts and flushes for region at 1675778579603Disabling writes for close at 1675778579603Writing region close event to WAL at 1675778579603Closed at 1675778579603 2023-02-07 14:02:59,607 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:59,607 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 8cec9d5f1cbe32deb3030b840075b733, disabling compactions & flushes 2023-02-07 14:02:59,607 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:02:59,608 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:02:59,608 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. after waiting 0 ms 2023-02-07 14:02:59,608 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:02:59,608 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:02:59,608 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 8cec9d5f1cbe32deb3030b840075b733: Waiting for close lock at 1675778579607Disabling compacts and flushes for region at 1675778579607Disabling writes for close at 1675778579608 (+1 ms)Writing region close event to WAL at 1675778579608Closed at 1675778579608 2023-02-07 14:02:59,636 INFO [RS:0;jenkins-hbase4:38051] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38051%2C1675778578037, suffix=, logDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/WALs/jenkins-hbase4.apache.org,38051,1675778578037, archiveDir=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/oldWALs, maxLogs=32 2023-02-07 14:02:59,654 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38447,DS-babb0997-8d31-41b9-8e98-84c046401930,DISK] 2023-02-07 14:02:59,655 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34201,DS-80f59229-b17e-4bd5-aabc-7589331ef179,DISK] 2023-02-07 14:02:59,657 INFO [RS:0;jenkins-hbase4:38051] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/WALs/jenkins-hbase4.apache.org,38051,1675778578037/jenkins-hbase4.apache.org%2C38051%2C1675778578037.1675778579637 2023-02-07 14:02:59,657 DEBUG [RS:0;jenkins-hbase4:38051] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38447,DS-babb0997-8d31-41b9-8e98-84c046401930,DISK], DatanodeInfoWithStorage[127.0.0.1:34201,DS-80f59229-b17e-4bd5-aabc-7589331ef179,DISK]] 2023-02-07 14:02:59,793 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:02:59,793 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:02:59,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:02:59,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:02:59,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b29449ae529fdca05cae653bea21a219, disabling compactions & flushes 2023-02-07 14:02:59,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:02:59,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:02:59,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. after waiting 0 ms 2023-02-07 14:02:59,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:02:59,966 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:02:59,966 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b29449ae529fdca05cae653bea21a219: Waiting for close lock at 1675778579966Disabling compacts and flushes for region at 1675778579966Disabling writes for close at 1675778579966Writing region close event to WAL at 1675778579966Closed at 1675778579966 2023-02-07 14:02:59,969 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:02:59,970 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778579970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778579970"}]},"ts":"1675778579970"} 2023-02-07 14:02:59,970 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778579970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778579970"}]},"ts":"1675778579970"} 2023-02-07 14:02:59,970 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778579970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778579970"}]},"ts":"1675778579970"} 2023-02-07 14:02:59,970 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778579970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778579970"}]},"ts":"1675778579970"} 2023-02-07 14:02:59,970 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778579970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778579970"}]},"ts":"1675778579970"} 2023-02-07 14:02:59,971 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778579970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778579970"}]},"ts":"1675778579970"} 2023-02-07 14:02:59,971 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778579970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778579970"}]},"ts":"1675778579970"} 2023-02-07 14:02:59,971 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778579970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778579970"}]},"ts":"1675778579970"} 2023-02-07 14:02:59,971 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778579970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778579970"}]},"ts":"1675778579970"} 2023-02-07 14:02:59,971 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1675778579484.b29449ae529fdca05cae653bea21a219.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778579970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778579970"}]},"ts":"1675778579970"} 2023-02-07 14:02:59,973 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-07 14:02:59,974 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:02:59,974 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778579974"}]},"ts":"1675778579974"} 2023-02-07 14:02:59,976 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-07 14:02:59,980 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:02:59,987 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:02:59,988 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:02:59,988 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:02:59,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1d96f10cad3fa67966a23bb1d9a51d39, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fbf5e715c5ad5096882efc3afdeb361a, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=73d71a6e15eb7562eeb109ee3a9dbb13, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b29449ae529fdca05cae653bea21a219, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b56d417a00b93a9a78fc601a14f3770a, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b8b3c36284ccb70b2e6cbad7c3742fd6, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c594c4d1559bf6f1b8483ad2ed4643c2, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e13b7676e6adda7db49592ff690641e6, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d72c5b2617af9d66aee7e9b65a3c57cf, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8cec9d5f1cbe32deb3030b840075b733, ASSIGN}] 2023-02-07 14:02:59,990 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=73d71a6e15eb7562eeb109ee3a9dbb13, ASSIGN 2023-02-07 14:02:59,990 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=fbf5e715c5ad5096882efc3afdeb361a, ASSIGN 2023-02-07 14:02:59,991 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1d96f10cad3fa67966a23bb1d9a51d39, ASSIGN 2023-02-07 14:02:59,991 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b29449ae529fdca05cae653bea21a219, ASSIGN 2023-02-07 14:02:59,991 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=73d71a6e15eb7562eeb109ee3a9dbb13, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38051,1675778578037; forceNewPlan=false, retain=false 2023-02-07 14:02:59,991 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=fbf5e715c5ad5096882efc3afdeb361a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39143,1675778578090; forceNewPlan=false, retain=false 2023-02-07 14:02:59,991 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1d96f10cad3fa67966a23bb1d9a51d39, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38051,1675778578037; forceNewPlan=false, retain=false 2023-02-07 14:02:59,992 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b29449ae529fdca05cae653bea21a219, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39143,1675778578090; forceNewPlan=false, retain=false 2023-02-07 14:02:59,992 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8cec9d5f1cbe32deb3030b840075b733, ASSIGN 2023-02-07 14:02:59,993 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d72c5b2617af9d66aee7e9b65a3c57cf, ASSIGN 2023-02-07 14:02:59,993 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e13b7676e6adda7db49592ff690641e6, ASSIGN 2023-02-07 14:02:59,993 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c594c4d1559bf6f1b8483ad2ed4643c2, ASSIGN 2023-02-07 14:02:59,993 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b8b3c36284ccb70b2e6cbad7c3742fd6, ASSIGN 2023-02-07 14:02:59,994 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d72c5b2617af9d66aee7e9b65a3c57cf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39143,1675778578090; forceNewPlan=false, retain=false 2023-02-07 14:02:59,994 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e13b7676e6adda7db49592ff690641e6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38051,1675778578037; forceNewPlan=false, retain=false 2023-02-07 14:02:59,994 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b8b3c36284ccb70b2e6cbad7c3742fd6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38051,1675778578037; forceNewPlan=false, retain=false 2023-02-07 14:02:59,994 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8cec9d5f1cbe32deb3030b840075b733, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38051,1675778578037; forceNewPlan=false, retain=false 2023-02-07 14:02:59,994 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c594c4d1559bf6f1b8483ad2ed4643c2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39143,1675778578090; forceNewPlan=false, retain=false 2023-02-07 14:02:59,995 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b56d417a00b93a9a78fc601a14f3770a, ASSIGN 2023-02-07 14:02:59,996 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b56d417a00b93a9a78fc601a14f3770a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39143,1675778578090; forceNewPlan=false, retain=false 2023-02-07 14:03:00,095 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:00,096 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:00,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:00,142 INFO [jenkins-hbase4:42615] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-07 14:03:00,145 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c594c4d1559bf6f1b8483ad2ed4643c2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:00,145 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b29449ae529fdca05cae653bea21a219, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:00,145 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=fbf5e715c5ad5096882efc3afdeb361a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:00,145 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b56d417a00b93a9a78fc601a14f3770a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:00,146 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1675778579484.b29449ae529fdca05cae653bea21a219.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580145"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778580145"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778580145"}]},"ts":"1675778580145"} 2023-02-07 14:03:00,145 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d72c5b2617af9d66aee7e9b65a3c57cf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:00,146 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580145"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778580145"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778580145"}]},"ts":"1675778580145"} 2023-02-07 14:03:00,146 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580145"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778580145"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778580145"}]},"ts":"1675778580145"} 2023-02-07 14:03:00,146 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580145"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778580145"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778580145"}]},"ts":"1675778580145"} 2023-02-07 14:03:00,146 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580145"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778580145"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778580145"}]},"ts":"1675778580145"} 2023-02-07 14:03:00,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure b29449ae529fdca05cae653bea21a219, server=jenkins-hbase4.apache.org,39143,1675778578090}] 2023-02-07 14:03:00,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=15, state=RUNNABLE; OpenRegionProcedure b56d417a00b93a9a78fc601a14f3770a, server=jenkins-hbase4.apache.org,39143,1675778578090}] 2023-02-07 14:03:00,149 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure fbf5e715c5ad5096882efc3afdeb361a, server=jenkins-hbase4.apache.org,39143,1675778578090}] 2023-02-07 14:03:00,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=19, state=RUNNABLE; OpenRegionProcedure d72c5b2617af9d66aee7e9b65a3c57cf, server=jenkins-hbase4.apache.org,39143,1675778578090}] 2023-02-07 14:03:00,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure c594c4d1559bf6f1b8483ad2ed4643c2, server=jenkins-hbase4.apache.org,39143,1675778578090}] 2023-02-07 14:03:00,154 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=73d71a6e15eb7562eeb109ee3a9dbb13, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:00,154 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1d96f10cad3fa67966a23bb1d9a51d39, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:00,154 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580154"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778580154"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778580154"}]},"ts":"1675778580154"} 2023-02-07 14:03:00,155 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778580154"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778580154"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778580154"}]},"ts":"1675778580154"} 2023-02-07 14:03:00,157 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8cec9d5f1cbe32deb3030b840075b733, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:00,158 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778580156"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778580156"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778580156"}]},"ts":"1675778580156"} 2023-02-07 14:03:00,160 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b8b3c36284ccb70b2e6cbad7c3742fd6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:00,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 1d96f10cad3fa67966a23bb1d9a51d39, server=jenkins-hbase4.apache.org,38051,1675778578037}] 2023-02-07 14:03:00,161 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580160"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778580160"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778580160"}]},"ts":"1675778580160"} 2023-02-07 14:03:00,161 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=e13b7676e6adda7db49592ff690641e6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:00,161 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778580161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778580161"}]},"ts":"1675778580161"} 2023-02-07 14:03:00,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=20, state=RUNNABLE; OpenRegionProcedure 8cec9d5f1cbe32deb3030b840075b733, server=jenkins-hbase4.apache.org,38051,1675778578037}] 2023-02-07 14:03:00,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=16, state=RUNNABLE; OpenRegionProcedure b8b3c36284ccb70b2e6cbad7c3742fd6, server=jenkins-hbase4.apache.org,38051,1675778578037}] 2023-02-07 14:03:00,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=18, state=RUNNABLE; OpenRegionProcedure e13b7676e6adda7db49592ff690641e6, server=jenkins-hbase4.apache.org,38051,1675778578037}] 2023-02-07 14:03:00,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=13, state=RUNNABLE; OpenRegionProcedure 73d71a6e15eb7562eeb109ee3a9dbb13, server=jenkins-hbase4.apache.org,38051,1675778578037}] 2023-02-07 14:03:00,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:00,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b56d417a00b93a9a78fc601a14f3770a, NAME => 'testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-07 14:03:00,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:03:00,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:00,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:03:00,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:03:00,314 INFO [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:03:00,315 DEBUG [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f1 2023-02-07 14:03:00,315 DEBUG [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f1 2023-02-07 14:03:00,315 INFO [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b56d417a00b93a9a78fc601a14f3770a columnFamilyName f1 2023-02-07 14:03:00,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:00,316 INFO [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] regionserver.HStore(310): Store=b56d417a00b93a9a78fc601a14f3770a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1d96f10cad3fa67966a23bb1d9a51d39, NAME => 'testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-07 14:03:00,316 INFO [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:03:00,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:03:00,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:00,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:03:00,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:03:00,318 DEBUG [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f2 2023-02-07 14:03:00,318 DEBUG [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f2 2023-02-07 14:03:00,318 INFO [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:03:00,318 INFO [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b56d417a00b93a9a78fc601a14f3770a columnFamilyName f2 2023-02-07 14:03:00,319 INFO [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] regionserver.HStore(310): Store=b56d417a00b93a9a78fc601a14f3770a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,319 DEBUG [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/1d96f10cad3fa67966a23bb1d9a51d39/f1 2023-02-07 14:03:00,319 DEBUG [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/1d96f10cad3fa67966a23bb1d9a51d39/f1 2023-02-07 14:03:00,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:03:00,319 INFO [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d96f10cad3fa67966a23bb1d9a51d39 columnFamilyName f1 2023-02-07 14:03:00,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:03:00,320 INFO [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] regionserver.HStore(310): Store=1d96f10cad3fa67966a23bb1d9a51d39/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,320 INFO [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:03:00,321 DEBUG [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/1d96f10cad3fa67966a23bb1d9a51d39/f2 2023-02-07 14:03:00,321 DEBUG [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/1d96f10cad3fa67966a23bb1d9a51d39/f2 2023-02-07 14:03:00,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:00,322 INFO [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d96f10cad3fa67966a23bb1d9a51d39 columnFamilyName f2 2023-02-07 14:03:00,322 INFO [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] regionserver.HStore(310): Store=1d96f10cad3fa67966a23bb1d9a51d39/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:03:00,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:03:00,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:03:00,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:00,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:00,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b56d417a00b93a9a78fc601a14f3770a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74336782, jitterRate=0.10770437121391296}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:00,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b56d417a00b93a9a78fc601a14f3770a: Running coprocessor pre-open hook at 1675778580309Writing region info on filesystem at 1675778580309Initializing all the Stores at 1675778580313 (+4 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580313Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580313Cleaning up temporary data from old regions at 1675778580321 (+8 ms)Cleaning up detritus from prior splits at 1675778580321Running coprocessor post-open hooks at 1675778580325 (+4 ms)Region opened successfully at 1675778580325 2023-02-07 14:03:00,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a., pid=22, masterSystemTime=1675778580301 2023-02-07 14:03:00,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:03:00,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:00,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:00,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:00,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c594c4d1559bf6f1b8483ad2ed4643c2, NAME => 'testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-07 14:03:00,329 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b56d417a00b93a9a78fc601a14f3770a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:00,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:03:00,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:00,329 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580329"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778580329"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778580329"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778580329"}]},"ts":"1675778580329"} 2023-02-07 14:03:00,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/1d96f10cad3fa67966a23bb1d9a51d39/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:00,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:03:00,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:03:00,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1d96f10cad3fa67966a23bb1d9a51d39; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64316007, jitterRate=-0.041616812348365784}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:00,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1d96f10cad3fa67966a23bb1d9a51d39: Running coprocessor pre-open hook at 1675778580317Writing region info on filesystem at 1675778580317Initializing all the Stores at 1675778580317Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580317Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580318 (+1 ms)Cleaning up temporary data from old regions at 1675778580324 (+6 ms)Cleaning up detritus from prior splits at 1675778580324Running coprocessor post-open hooks at 1675778580330 (+6 ms)Region opened successfully at 1675778580330 2023-02-07 14:03:00,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39., pid=27, masterSystemTime=1675778580312 2023-02-07 14:03:00,331 INFO [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:03:00,333 DEBUG [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f1 2023-02-07 14:03:00,333 DEBUG [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f1 2023-02-07 14:03:00,333 INFO [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c594c4d1559bf6f1b8483ad2ed4643c2 columnFamilyName f1 2023-02-07 14:03:00,334 INFO [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] regionserver.HStore(310): Store=c594c4d1559bf6f1b8483ad2ed4643c2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,334 INFO [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:03:00,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:00,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:00,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:00,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e13b7676e6adda7db49592ff690641e6, NAME => 'testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-07 14:03:00,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=15 2023-02-07 14:03:00,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=15, state=SUCCESS; OpenRegionProcedure b56d417a00b93a9a78fc601a14f3770a, server=jenkins-hbase4.apache.org,39143,1675778578090 in 183 msec 2023-02-07 14:03:00,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e13b7676e6adda7db49592ff690641e6 2023-02-07 14:03:00,335 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=1d96f10cad3fa67966a23bb1d9a51d39, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:00,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:00,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e13b7676e6adda7db49592ff690641e6 2023-02-07 14:03:00,335 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778580335"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778580335"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778580335"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778580335"}]},"ts":"1675778580335"} 2023-02-07 14:03:00,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e13b7676e6adda7db49592ff690641e6 2023-02-07 14:03:00,336 DEBUG [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f2 2023-02-07 14:03:00,336 DEBUG [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f2 2023-02-07 14:03:00,336 INFO [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c594c4d1559bf6f1b8483ad2ed4643c2 columnFamilyName f2 2023-02-07 14:03:00,337 INFO [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] regionserver.HStore(310): Store=c594c4d1559bf6f1b8483ad2ed4643c2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b56d417a00b93a9a78fc601a14f3770a, ASSIGN in 347 msec 2023-02-07 14:03:00,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-07 14:03:00,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 1d96f10cad3fa67966a23bb1d9a51d39, server=jenkins-hbase4.apache.org,38051,1675778578037 in 176 msec 2023-02-07 14:03:00,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1d96f10cad3fa67966a23bb1d9a51d39, ASSIGN in 351 msec 2023-02-07 14:03:00,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:03:00,341 INFO [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e13b7676e6adda7db49592ff690641e6 2023-02-07 14:03:00,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:03:00,342 DEBUG [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f1 2023-02-07 14:03:00,342 DEBUG [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f1 2023-02-07 14:03:00,343 INFO [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e13b7676e6adda7db49592ff690641e6 columnFamilyName f1 2023-02-07 14:03:00,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:00,344 INFO [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] regionserver.HStore(310): Store=e13b7676e6adda7db49592ff690641e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,344 INFO [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e13b7676e6adda7db49592ff690641e6 2023-02-07 14:03:00,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:03:00,345 DEBUG [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f2 2023-02-07 14:03:00,346 DEBUG [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f2 2023-02-07 14:03:00,346 INFO [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e13b7676e6adda7db49592ff690641e6 columnFamilyName f2 2023-02-07 14:03:00,346 INFO [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] regionserver.HStore(310): Store=e13b7676e6adda7db49592ff690641e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:00,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6 2023-02-07 14:03:00,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c594c4d1559bf6f1b8483ad2ed4643c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63673490, jitterRate=-0.0511910617351532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:00,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c594c4d1559bf6f1b8483ad2ed4643c2: Running coprocessor pre-open hook at 1675778580330Writing region info on filesystem at 1675778580330Initializing all the Stores at 1675778580331 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580331Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580331Cleaning up temporary data from old regions at 1675778580342 (+11 ms)Cleaning up detritus from prior splits at 1675778580342Running coprocessor post-open hooks at 1675778580347 (+5 ms)Region opened successfully at 1675778580347 2023-02-07 14:03:00,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6 2023-02-07 14:03:00,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2., pid=25, masterSystemTime=1675778580301 2023-02-07 14:03:00,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:00,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:00,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:00,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:00,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fbf5e715c5ad5096882efc3afdeb361a, NAME => 'testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-07 14:03:00,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:03:00,351 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c594c4d1559bf6f1b8483ad2ed4643c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:00,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:00,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:03:00,351 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580351"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778580351"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778580351"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778580351"}]},"ts":"1675778580351"} 2023-02-07 14:03:00,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e13b7676e6adda7db49592ff690641e6 2023-02-07 14:03:00,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:03:00,353 INFO [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:03:00,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:00,355 DEBUG [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f1 2023-02-07 14:03:00,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-07 14:03:00,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e13b7676e6adda7db49592ff690641e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70650869, jitterRate=0.05277998745441437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:00,355 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure c594c4d1559bf6f1b8483ad2ed4643c2, server=jenkins-hbase4.apache.org,39143,1675778578090 in 201 msec 2023-02-07 14:03:00,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e13b7676e6adda7db49592ff690641e6: Running coprocessor pre-open hook at 1675778580336Writing region info on filesystem at 1675778580336Initializing all the Stores at 1675778580340 (+4 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580341 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580341Cleaning up temporary data from old regions at 1675778580348 (+7 ms)Cleaning up detritus from prior splits at 1675778580349 (+1 ms)Running coprocessor post-open hooks at 1675778580355 (+6 ms)Region opened successfully at 1675778580355 2023-02-07 14:03:00,355 DEBUG [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f1 2023-02-07 14:03:00,356 INFO [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbf5e715c5ad5096882efc3afdeb361a columnFamilyName f1 2023-02-07 14:03:00,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6., pid=30, masterSystemTime=1675778580312 2023-02-07 14:03:00,356 INFO [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] regionserver.HStore(310): Store=fbf5e715c5ad5096882efc3afdeb361a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,357 INFO [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:03:00,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c594c4d1559bf6f1b8483ad2ed4643c2, ASSIGN in 367 msec 2023-02-07 14:03:00,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:00,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:00,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:00,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b8b3c36284ccb70b2e6cbad7c3742fd6, NAME => 'testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-07 14:03:00,358 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=e13b7676e6adda7db49592ff690641e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:00,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:03:00,358 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580358"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778580358"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778580358"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778580358"}]},"ts":"1675778580358"} 2023-02-07 14:03:00,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:00,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:03:00,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:03:00,360 INFO [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:03:00,362 DEBUG [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f1 2023-02-07 14:03:00,362 DEBUG [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f1 2023-02-07 14:03:00,362 INFO [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8b3c36284ccb70b2e6cbad7c3742fd6 columnFamilyName f1 2023-02-07 14:03:00,363 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=18 2023-02-07 14:03:00,363 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=18, state=SUCCESS; OpenRegionProcedure e13b7676e6adda7db49592ff690641e6, server=jenkins-hbase4.apache.org,38051,1675778578037 in 197 msec 2023-02-07 14:03:00,363 INFO [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] regionserver.HStore(310): Store=b8b3c36284ccb70b2e6cbad7c3742fd6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,363 INFO [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:03:00,364 DEBUG [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f2 2023-02-07 14:03:00,364 DEBUG [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f2 2023-02-07 14:03:00,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e13b7676e6adda7db49592ff690641e6, ASSIGN in 375 msec 2023-02-07 14:03:00,364 INFO [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbf5e715c5ad5096882efc3afdeb361a columnFamilyName f2 2023-02-07 14:03:00,364 DEBUG [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f2 2023-02-07 14:03:00,365 DEBUG [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f2 2023-02-07 14:03:00,365 INFO [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8b3c36284ccb70b2e6cbad7c3742fd6 columnFamilyName f2 2023-02-07 14:03:00,365 INFO [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] regionserver.HStore(310): Store=fbf5e715c5ad5096882efc3afdeb361a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,365 INFO [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] regionserver.HStore(310): Store=b8b3c36284ccb70b2e6cbad7c3742fd6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:03:00,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:03:00,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:00,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:03:00,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:00,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b8b3c36284ccb70b2e6cbad7c3742fd6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73733182, jitterRate=0.09871003031730652}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:00,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b8b3c36284ccb70b2e6cbad7c3742fd6: Running coprocessor pre-open hook at 1675778580359Writing region info on filesystem at 1675778580359Initializing all the Stores at 1675778580360 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580360Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580360Cleaning up temporary data from old regions at 1675778580367 (+7 ms)Cleaning up detritus from prior splits at 1675778580368 (+1 ms)Running coprocessor post-open hooks at 1675778580372 (+4 ms)Region opened successfully at 1675778580372 2023-02-07 14:03:00,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:03:00,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:03:00,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6., pid=29, masterSystemTime=1675778580312 2023-02-07 14:03:00,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:00,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:00,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:00,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8cec9d5f1cbe32deb3030b840075b733, NAME => 'testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-07 14:03:00,376 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b8b3c36284ccb70b2e6cbad7c3742fd6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:00,376 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580375"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778580375"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778580375"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778580375"}]},"ts":"1675778580375"} 2023-02-07 14:03:00,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:03:00,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:00,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:03:00,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:03:00,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:00,377 INFO [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:03:00,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:03:00,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=16 2023-02-07 14:03:00,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=16, state=SUCCESS; OpenRegionProcedure b8b3c36284ccb70b2e6cbad7c3742fd6, server=jenkins-hbase4.apache.org,38051,1675778578037 in 214 msec 2023-02-07 14:03:00,380 DEBUG [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/8cec9d5f1cbe32deb3030b840075b733/f1 2023-02-07 14:03:00,380 DEBUG [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/8cec9d5f1cbe32deb3030b840075b733/f1 2023-02-07 14:03:00,381 INFO [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cec9d5f1cbe32deb3030b840075b733 columnFamilyName f1 2023-02-07 14:03:00,381 INFO [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] regionserver.HStore(310): Store=8cec9d5f1cbe32deb3030b840075b733/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,382 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b8b3c36284ccb70b2e6cbad7c3742fd6, ASSIGN in 392 msec 2023-02-07 14:03:00,382 INFO [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:03:00,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:00,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fbf5e715c5ad5096882efc3afdeb361a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63407055, jitterRate=-0.055161252617836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:00,383 DEBUG [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/8cec9d5f1cbe32deb3030b840075b733/f2 2023-02-07 14:03:00,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fbf5e715c5ad5096882efc3afdeb361a: Running coprocessor pre-open hook at 1675778580352Writing region info on filesystem at 1675778580352Initializing all the Stores at 1675778580353 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580353Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580353Cleaning up temporary data from old regions at 1675778580375 (+22 ms)Cleaning up detritus from prior splits at 1675778580376 (+1 ms)Running coprocessor post-open hooks at 1675778580383 (+7 ms)Region opened successfully at 1675778580383 2023-02-07 14:03:00,383 DEBUG [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/8cec9d5f1cbe32deb3030b840075b733/f2 2023-02-07 14:03:00,384 INFO [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cec9d5f1cbe32deb3030b840075b733 columnFamilyName f2 2023-02-07 14:03:00,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a., pid=23, masterSystemTime=1675778580301 2023-02-07 14:03:00,384 INFO [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] regionserver.HStore(310): Store=8cec9d5f1cbe32deb3030b840075b733/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:03:00,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:00,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:00,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:03:00,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:00,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b29449ae529fdca05cae653bea21a219, NAME => 'testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-07 14:03:00,386 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=fbf5e715c5ad5096882efc3afdeb361a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:00,386 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580386"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778580386"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778580386"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778580386"}]},"ts":"1675778580386"} 2023-02-07 14:03:00,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b29449ae529fdca05cae653bea21a219 2023-02-07 14:03:00,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:00,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b29449ae529fdca05cae653bea21a219 2023-02-07 14:03:00,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b29449ae529fdca05cae653bea21a219 2023-02-07 14:03:00,388 INFO [StoreOpener-b29449ae529fdca05cae653bea21a219-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b29449ae529fdca05cae653bea21a219 2023-02-07 14:03:00,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:00,391 DEBUG [StoreOpener-b29449ae529fdca05cae653bea21a219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f1 2023-02-07 14:03:00,391 DEBUG [StoreOpener-b29449ae529fdca05cae653bea21a219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f1 2023-02-07 14:03:00,392 INFO [StoreOpener-b29449ae529fdca05cae653bea21a219-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b29449ae529fdca05cae653bea21a219 columnFamilyName f1 2023-02-07 14:03:00,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-07 14:03:00,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure fbf5e715c5ad5096882efc3afdeb361a, server=jenkins-hbase4.apache.org,39143,1675778578090 in 239 msec 2023-02-07 14:03:00,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:03:00,392 INFO [StoreOpener-b29449ae529fdca05cae653bea21a219-1] regionserver.HStore(310): Store=b29449ae529fdca05cae653bea21a219/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,392 INFO [StoreOpener-b29449ae529fdca05cae653bea21a219-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b29449ae529fdca05cae653bea21a219 2023-02-07 14:03:00,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=fbf5e715c5ad5096882efc3afdeb361a, ASSIGN in 404 msec 2023-02-07 14:03:00,394 DEBUG [StoreOpener-b29449ae529fdca05cae653bea21a219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f2 2023-02-07 14:03:00,394 DEBUG [StoreOpener-b29449ae529fdca05cae653bea21a219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f2 2023-02-07 14:03:00,394 INFO [StoreOpener-b29449ae529fdca05cae653bea21a219-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b29449ae529fdca05cae653bea21a219 columnFamilyName f2 2023-02-07 14:03:00,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/8cec9d5f1cbe32deb3030b840075b733/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:00,395 INFO [StoreOpener-b29449ae529fdca05cae653bea21a219-1] regionserver.HStore(310): Store=b29449ae529fdca05cae653bea21a219/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8cec9d5f1cbe32deb3030b840075b733; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69359274, jitterRate=0.033533722162246704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:00,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8cec9d5f1cbe32deb3030b840075b733: Running coprocessor pre-open hook at 1675778580376Writing region info on filesystem at 1675778580376Initializing all the Stores at 1675778580377 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580377Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580377Cleaning up temporary data from old regions at 1675778580387 (+10 ms)Cleaning up detritus from prior splits at 1675778580388 (+1 ms)Running coprocessor post-open hooks at 1675778580395 (+7 ms)Region opened successfully at 1675778580395 2023-02-07 14:03:00,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219 2023-02-07 14:03:00,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733., pid=28, masterSystemTime=1675778580312 2023-02-07 14:03:00,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219 2023-02-07 14:03:00,398 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8cec9d5f1cbe32deb3030b840075b733, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:00,399 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1675778580398"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778580398"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778580398"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778580398"}]},"ts":"1675778580398"} 2023-02-07 14:03:00,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:00,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:00,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:00,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:00,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b29449ae529fdca05cae653bea21a219 2023-02-07 14:03:00,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 73d71a6e15eb7562eeb109ee3a9dbb13, NAME => 'testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-07 14:03:00,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:03:00,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:00,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:03:00,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:03:00,402 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=20 2023-02-07 14:03:00,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=20, state=SUCCESS; OpenRegionProcedure 8cec9d5f1cbe32deb3030b840075b733, server=jenkins-hbase4.apache.org,38051,1675778578037 in 238 msec 2023-02-07 14:03:00,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8cec9d5f1cbe32deb3030b840075b733, ASSIGN in 414 msec 2023-02-07 14:03:00,404 INFO [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:03:00,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:00,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b29449ae529fdca05cae653bea21a219; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75055739, jitterRate=0.1184176653623581}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:00,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b29449ae529fdca05cae653bea21a219: Running coprocessor pre-open hook at 1675778580387Writing region info on filesystem at 1675778580387Initializing all the Stores at 1675778580388 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580388Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580388Cleaning up temporary data from old regions at 1675778580397 (+9 ms)Cleaning up detritus from prior splits at 1675778580398 (+1 ms)Running coprocessor post-open hooks at 1675778580405 (+7 ms)Region opened successfully at 1675778580405 2023-02-07 14:03:00,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219., pid=21, masterSystemTime=1675778580301 2023-02-07 14:03:00,406 DEBUG [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f1 2023-02-07 14:03:00,406 DEBUG [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f1 2023-02-07 14:03:00,406 INFO [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73d71a6e15eb7562eeb109ee3a9dbb13 columnFamilyName f1 2023-02-07 14:03:00,407 INFO [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] regionserver.HStore(310): Store=73d71a6e15eb7562eeb109ee3a9dbb13/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,407 INFO [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:03:00,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:00,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:00,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:00,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d72c5b2617af9d66aee7e9b65a3c57cf, NAME => 'testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-07 14:03:00,408 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=b29449ae529fdca05cae653bea21a219, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:00,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:03:00,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:00,408 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1675778579484.b29449ae529fdca05cae653bea21a219.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580408"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778580408"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778580408"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778580408"}]},"ts":"1675778580408"} 2023-02-07 14:03:00,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:03:00,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:03:00,408 DEBUG [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f2 2023-02-07 14:03:00,408 DEBUG [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f2 2023-02-07 14:03:00,409 INFO [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73d71a6e15eb7562eeb109ee3a9dbb13 columnFamilyName f2 2023-02-07 14:03:00,409 INFO [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:03:00,409 INFO [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] regionserver.HStore(310): Store=73d71a6e15eb7562eeb109ee3a9dbb13/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:03:00,411 DEBUG [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f1 2023-02-07 14:03:00,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:03:00,411 DEBUG [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f1 2023-02-07 14:03:00,411 INFO [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d72c5b2617af9d66aee7e9b65a3c57cf columnFamilyName f1 2023-02-07 14:03:00,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-07 14:03:00,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure b29449ae529fdca05cae653bea21a219, server=jenkins-hbase4.apache.org,39143,1675778578090 in 262 msec 2023-02-07 14:03:00,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b29449ae529fdca05cae653bea21a219, ASSIGN in 423 msec 2023-02-07 14:03:00,414 INFO [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] regionserver.HStore(310): Store=d72c5b2617af9d66aee7e9b65a3c57cf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,414 INFO [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:03:00,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:00,416 DEBUG [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f2 2023-02-07 14:03:00,416 DEBUG [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f2 2023-02-07 14:03:00,416 INFO [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d72c5b2617af9d66aee7e9b65a3c57cf columnFamilyName f2 2023-02-07 14:03:00,416 INFO [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] regionserver.HStore(310): Store=d72c5b2617af9d66aee7e9b65a3c57cf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:00,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:03:00,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:03:00,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:03:00,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:00,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 73d71a6e15eb7562eeb109ee3a9dbb13; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69052434, jitterRate=0.02896144986152649}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:00,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:00,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 73d71a6e15eb7562eeb109ee3a9dbb13: Running coprocessor pre-open hook at 1675778580403Writing region info on filesystem at 1675778580403Initializing all the Stores at 1675778580404 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580404Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580404Cleaning up temporary data from old regions at 1675778580414 (+10 ms)Cleaning up detritus from prior splits at 1675778580415 (+1 ms)Running coprocessor post-open hooks at 1675778580419 (+4 ms)Region opened successfully at 1675778580419 2023-02-07 14:03:00,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13., pid=26, masterSystemTime=1675778580312 2023-02-07 14:03:00,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:03:00,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:00,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:00,423 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=73d71a6e15eb7562eeb109ee3a9dbb13, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:00,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:00,423 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580422"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778580422"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778580422"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778580422"}]},"ts":"1675778580422"} 2023-02-07 14:03:00,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d72c5b2617af9d66aee7e9b65a3c57cf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71443225, jitterRate=0.06458701193332672}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:00,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d72c5b2617af9d66aee7e9b65a3c57cf: Running coprocessor pre-open hook at 1675778580408Writing region info on filesystem at 1675778580408Initializing all the Stores at 1675778580409 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580409Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778580409Cleaning up temporary data from old regions at 1675778580418 (+9 ms)Cleaning up detritus from prior splits at 1675778580419 (+1 ms)Running coprocessor post-open hooks at 1675778580423 (+4 ms)Region opened successfully at 1675778580423 2023-02-07 14:03:00,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf., pid=24, masterSystemTime=1675778580301 2023-02-07 14:03:00,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:00,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:00,426 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d72c5b2617af9d66aee7e9b65a3c57cf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:00,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=13 2023-02-07 14:03:00,427 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1675778580426"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778580426"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778580426"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778580426"}]},"ts":"1675778580426"} 2023-02-07 14:03:00,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=13, state=SUCCESS; OpenRegionProcedure 73d71a6e15eb7562eeb109ee3a9dbb13, server=jenkins-hbase4.apache.org,38051,1675778578037 in 266 msec 2023-02-07 14:03:00,428 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=73d71a6e15eb7562eeb109ee3a9dbb13, ASSIGN in 439 msec 2023-02-07 14:03:00,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=19 2023-02-07 14:03:00,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=19, state=SUCCESS; OpenRegionProcedure d72c5b2617af9d66aee7e9b65a3c57cf, server=jenkins-hbase4.apache.org,39143,1675778578090 in 277 msec 2023-02-07 14:03:00,432 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=19, resume processing ppid=10 2023-02-07 14:03:00,432 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d72c5b2617af9d66aee7e9b65a3c57cf, ASSIGN in 442 msec 2023-02-07 14:03:00,432 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:03:00,432 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778580432"}]},"ts":"1675778580432"} 2023-02-07 14:03:00,434 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-07 14:03:00,436 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:03:00,437 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 951 msec 2023-02-07 14:03:00,597 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:00,598 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:00,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:00,599 INFO [Listener at localhost/44779] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-07 14:03:00,600 DEBUG [Listener at localhost/44779] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-07 14:03:00,600 INFO [Listener at localhost/44779] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:03:00,604 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-07 14:03:00,604 INFO [Listener at localhost/44779] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:03:00,604 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-07 14:03:00,604 INFO [Listener at localhost/44779] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 14:03:00,668 DEBUG [hconnection-0x56e0690c-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:00,684 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:00,689 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52814, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:00,703 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39143] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:00,798 INFO [Listener at localhost/44779] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 14:03:00,798 INFO [Listener at localhost/44779] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 14:03:00,798 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:00,799 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:00,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 14:03:00,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675778580800 (current time:1675778580800). 2023-02-07 14:03:00,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 14:03:00,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] zookeeper.ReadOnlyZKClient(139): Connect 0x592f84bb to 127.0.0.1:49376 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:00,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1668c6b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:00,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:00,811 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45128, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:00,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x592f84bb to 127.0.0.1:49376 2023-02-07 14:03:00,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:00,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 14:03:00,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 14:03:00,815 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 14:03:00,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 14:03:00,817 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 14:03:00,818 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675779180818 2023-02-07 14:03:00,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 14:03:00,823 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-07 14:03:00,825 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 14:03:00,825 DEBUG [Listener at localhost/44779] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 14:03:00,825 DEBUG [Listener at localhost/44779] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 14:03:00,826 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 10 msec 2023-02-07 14:03:00,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 14:03:00,829 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 14:03:00,830 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675779180830 2023-02-07 14:03:00,925 DEBUG [Listener at localhost/44779] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:00,925 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:00,925 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:00,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 14:03:00,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:03:00,927 DEBUG [Listener at localhost/44779] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 14:03:01,127 DEBUG [Listener at localhost/44779] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:01,128 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:01,128 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:01,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 14:03:01,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:03:01,130 DEBUG [Listener at localhost/44779] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-07 14:03:01,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,259 INFO [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-07 14:03:01,259 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:01,259 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-07 14:03:01,259 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-07 14:03:01,260 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,260 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,263 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:01,263 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:01,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:01,263 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:01,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:01,263 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,263 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,264 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,264 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:03:01,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-07 14:03:01,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-07 14:03:01,264 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-07 14:03:01,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,265 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-07 14:03:01,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,268 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-07 14:03:01,268 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:01,272 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-07 14:03:01,272 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-07 14:03:01,272 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-07 14:03:01,272 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:01,272 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38051,1675778578037' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-07 14:03:01,273 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-07 14:03:01,273 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-07 14:03:01,273 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39143,1675778578090' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-07 14:03:01,274 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,275 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,275 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,275 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:01,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:01,275 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,275 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,275 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:01,275 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:01,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:01,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:01,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:01,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39143,1675778578090' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-07 14:03:01,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5834096d[Count = 1] remaining members to acquire global barrier 2023-02-07 14:03:01,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:01,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:01,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:01,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:01,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:01,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38051,1675778578037' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-07 14:03:01,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5834096d[Count = 0] remaining members to acquire global barrier 2023-02-07 14:03:01,280 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-07 14:03:01,280 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,281 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,281 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,281 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-07 14:03:01,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,281 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-07 14:03:01,281 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,282 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:01,282 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:01,282 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. started... 2023-02-07 14:03:01,282 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. started... 2023-02-07 14:03:01,283 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e13b7676e6adda7db49592ff690641e6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:03:01,283 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:01,283 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d72c5b2617af9d66aee7e9b65a3c57cf 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 14:03:01,283 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. started... 2023-02-07 14:03:01,283 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:01,283 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,283 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:03:01,283 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 14:03:01,284 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 14:03:01,284 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:01,284 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. started... 2023-02-07 14:03:01,284 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:01,285 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. started... 2023-02-07 14:03:01,283 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. started... 2023-02-07 14:03:01,283 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 14:03:01,285 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 14:03:01,295 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8cec9d5f1cbe32deb3030b840075b733: 2023-02-07 14:03:01,295 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HRegion(2744): Flushing b56d417a00b93a9a78fc601a14f3770a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:03:01,295 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 1d96f10cad3fa67966a23bb1d9a51d39: 2023-02-07 14:03:01,295 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c594c4d1559bf6f1b8483ad2ed4643c2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:03:01,296 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,296 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:01,296 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 14:03:01,296 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 14:03:01,295 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,302 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:01,303 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 14:03:01,303 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 14:03:01,329 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/.tmp/f1/35d4965645c543578bfd47a2782a4b95 2023-02-07 14:03:01,352 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/.tmp/f1/f08bc78eec0e4c72be0e628e8f4fb8c6 2023-02-07 14:03:01,373 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/.tmp/f1/359a9744b8e24db2b6af3091b7d5c4e7 2023-02-07 14:03:01,375 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. completed. 2023-02-07 14:03:01,375 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:01,375 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:01,375 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 14:03:01,375 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. started... 2023-02-07 14:03:01,376 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. completed. 2023-02-07 14:03:01,376 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:01,381 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 14:03:01,381 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] regionserver.HRegion(2744): Flushing b8b3c36284ccb70b2e6cbad7c3742fd6 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:03:01,381 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:01,382 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. started... 2023-02-07 14:03:01,383 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 73d71a6e15eb7562eeb109ee3a9dbb13 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:03:01,388 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/.tmp/f1/3602e0eedecf4941836bb758315afd57 2023-02-07 14:03:01,404 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/.tmp/f2/dc7cbcb67b4847a09817fa9f4eecc52c 2023-02-07 14:03:01,419 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/.tmp/f1/35d4965645c543578bfd47a2782a4b95 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f1/35d4965645c543578bfd47a2782a4b95 2023-02-07 14:03:01,428 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/.tmp/f1/15c02e445f7343fdb647ddd354c71bd9 2023-02-07 14:03:01,430 DEBUG [Listener at localhost/44779] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:01,430 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:01,430 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:01,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 14:03:01,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:03:01,433 DEBUG [Listener at localhost/44779] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-07 14:03:01,441 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f1/35d4965645c543578bfd47a2782a4b95, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 14:03:01,442 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/.tmp/f2/dc7cbcb67b4847a09817fa9f4eecc52c as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f2/dc7cbcb67b4847a09817fa9f4eecc52c 2023-02-07 14:03:01,443 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/.tmp/f1/94e7ed8907644ac8bba0fb3e9ad3b673 2023-02-07 14:03:01,456 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/.tmp/f2/becf8417709044c58ec595fab5ad372b 2023-02-07 14:03:01,457 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/.tmp/f2/5221476f7c114210bf9cdaa6de98550c 2023-02-07 14:03:01,463 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f2/dc7cbcb67b4847a09817fa9f4eecc52c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 14:03:01,465 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for d72c5b2617af9d66aee7e9b65a3c57cf in 182ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:01,465 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-07 14:03:01,466 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d72c5b2617af9d66aee7e9b65a3c57cf: 2023-02-07 14:03:01,466 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,466 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:01,466 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f1/35d4965645c543578bfd47a2782a4b95] hfiles 2023-02-07 14:03:01,466 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f1/35d4965645c543578bfd47a2782a4b95 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,466 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f2/dc7cbcb67b4847a09817fa9f4eecc52c] hfiles 2023-02-07 14:03:01,466 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f2/dc7cbcb67b4847a09817fa9f4eecc52c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,467 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/.tmp/f2/98e72570a1674bbea9aab469ce05131d 2023-02-07 14:03:01,471 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/.tmp/f1/359a9744b8e24db2b6af3091b7d5c4e7 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f1/359a9744b8e24db2b6af3091b7d5c4e7 2023-02-07 14:03:01,472 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/.tmp/f1/f08bc78eec0e4c72be0e628e8f4fb8c6 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f1/f08bc78eec0e4c72be0e628e8f4fb8c6 2023-02-07 14:03:01,479 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f1/f08bc78eec0e4c72be0e628e8f4fb8c6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:01,480 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/.tmp/f1/3602e0eedecf4941836bb758315afd57 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f1/3602e0eedecf4941836bb758315afd57 2023-02-07 14:03:01,480 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/.tmp/f2/5221476f7c114210bf9cdaa6de98550c as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f2/5221476f7c114210bf9cdaa6de98550c 2023-02-07 14:03:01,482 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f1/359a9744b8e24db2b6af3091b7d5c4e7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:01,495 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/.tmp/f2/becf8417709044c58ec595fab5ad372b as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f2/becf8417709044c58ec595fab5ad372b 2023-02-07 14:03:01,499 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f2/5221476f7c114210bf9cdaa6de98550c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:01,501 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e13b7676e6adda7db49592ff690641e6 in 218ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:01,502 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e13b7676e6adda7db49592ff690641e6: 2023-02-07 14:03:01,502 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,502 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:01,502 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f1/f08bc78eec0e4c72be0e628e8f4fb8c6] hfiles 2023-02-07 14:03:01,502 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f1/f08bc78eec0e4c72be0e628e8f4fb8c6 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,502 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f2/5221476f7c114210bf9cdaa6de98550c] hfiles 2023-02-07 14:03:01,502 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f2/5221476f7c114210bf9cdaa6de98550c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,504 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f1/3602e0eedecf4941836bb758315afd57, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:01,506 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/.tmp/f2/98e72570a1674bbea9aab469ce05131d as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f2/98e72570a1674bbea9aab469ce05131d 2023-02-07 14:03:01,506 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f2/becf8417709044c58ec595fab5ad372b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:01,508 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b56d417a00b93a9a78fc601a14f3770a in 213ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:01,508 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b56d417a00b93a9a78fc601a14f3770a: 2023-02-07 14:03:01,508 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,508 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:01,508 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f1/359a9744b8e24db2b6af3091b7d5c4e7] hfiles 2023-02-07 14:03:01,508 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f1/359a9744b8e24db2b6af3091b7d5c4e7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,508 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f2/becf8417709044c58ec595fab5ad372b] hfiles 2023-02-07 14:03:01,508 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f2/becf8417709044c58ec595fab5ad372b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,509 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/.tmp/f2/f9ce2e5e5e954d04a8c72a51f19e144f 2023-02-07 14:03:01,521 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/.tmp/f2/9c5103ed9cc44e31a7381e2157aeb365 2023-02-07 14:03:01,531 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/.tmp/f1/15c02e445f7343fdb647ddd354c71bd9 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f1/15c02e445f7343fdb647ddd354c71bd9 2023-02-07 14:03:01,533 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. completed. 2023-02-07 14:03:01,533 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:01,533 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:01,533 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 14:03:01,533 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. started... 2023-02-07 14:03:01,533 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HRegion(2744): Flushing fbf5e715c5ad5096882efc3afdeb361a 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 14:03:01,535 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. completed. 2023-02-07 14:03:01,535 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:01,535 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 14:03:01,536 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f2/98e72570a1674bbea9aab469ce05131d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:01,538 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c594c4d1559bf6f1b8483ad2ed4643c2 in 243ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:01,538 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c594c4d1559bf6f1b8483ad2ed4643c2: 2023-02-07 14:03:01,538 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,538 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:01,538 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f1/3602e0eedecf4941836bb758315afd57] hfiles 2023-02-07 14:03:01,538 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f1/3602e0eedecf4941836bb758315afd57 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,538 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f1/15c02e445f7343fdb647ddd354c71bd9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:01,538 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f2/98e72570a1674bbea9aab469ce05131d] hfiles 2023-02-07 14:03:01,538 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f2/98e72570a1674bbea9aab469ce05131d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,539 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/.tmp/f1/94e7ed8907644ac8bba0fb3e9ad3b673 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f1/94e7ed8907644ac8bba0fb3e9ad3b673 2023-02-07 14:03:01,540 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/.tmp/f2/9c5103ed9cc44e31a7381e2157aeb365 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f2/9c5103ed9cc44e31a7381e2157aeb365 2023-02-07 14:03:01,546 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f1/94e7ed8907644ac8bba0fb3e9ad3b673, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:01,547 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/.tmp/f2/f9ce2e5e5e954d04a8c72a51f19e144f as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f2/f9ce2e5e5e954d04a8c72a51f19e144f 2023-02-07 14:03:01,548 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. completed. 2023-02-07 14:03:01,548 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:01,548 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:01,548 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 14:03:01,548 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. started... 2023-02-07 14:03:01,548 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HRegion(2744): Flushing b29449ae529fdca05cae653bea21a219 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:03:01,552 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f2/9c5103ed9cc44e31a7381e2157aeb365, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:01,553 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b8b3c36284ccb70b2e6cbad7c3742fd6 in 172ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:01,553 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b8b3c36284ccb70b2e6cbad7c3742fd6: 2023-02-07 14:03:01,553 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,553 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:01,553 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f1/15c02e445f7343fdb647ddd354c71bd9] hfiles 2023-02-07 14:03:01,553 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f1/15c02e445f7343fdb647ddd354c71bd9 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,554 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f2/9c5103ed9cc44e31a7381e2157aeb365] hfiles 2023-02-07 14:03:01,554 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f2/9c5103ed9cc44e31a7381e2157aeb365 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,563 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f2/f9ce2e5e5e954d04a8c72a51f19e144f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:01,564 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 73d71a6e15eb7562eeb109ee3a9dbb13 in 182ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:01,564 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 73d71a6e15eb7562eeb109ee3a9dbb13: 2023-02-07 14:03:01,564 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,564 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:01,564 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f1/94e7ed8907644ac8bba0fb3e9ad3b673] hfiles 2023-02-07 14:03:01,565 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f1/94e7ed8907644ac8bba0fb3e9ad3b673 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,565 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f2/f9ce2e5e5e954d04a8c72a51f19e144f] hfiles 2023-02-07 14:03:01,565 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f2/f9ce2e5e5e954d04a8c72a51f19e144f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,580 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. completed. 2023-02-07 14:03:01,580 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:01,580 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 14:03:01,582 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/.tmp/f1/9eb549054785402095a316a55ececbe5 2023-02-07 14:03:01,597 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. completed. 2023-02-07 14:03:01,597 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:01,597 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 14:03:01,600 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/.tmp/f1/0ccdb7efcc9d4a4c9f5a753a21facacb 2023-02-07 14:03:01,612 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. completed. 2023-02-07 14:03:01,612 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:01,612 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 14:03:01,612 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 14:03:01,612 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,660 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-07 14:03:01,660 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,38051,1675778578037' in zk 2023-02-07 14:03:01,663 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-07 14:03:01,663 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,663 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:01,664 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-07 14:03:01,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:01,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:01,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:01,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:01,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:01,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,38051,1675778578037': 2023-02-07 14:03:01,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38051,1675778578037' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-07 14:03:01,679 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/.tmp/f2/50fc0f0cabf64c0794844cc027d4d85a 2023-02-07 14:03:01,685 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/.tmp/f2/0e087b1dd9b6495fa69a7fbc1390bd40 2023-02-07 14:03:01,690 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/.tmp/f1/9eb549054785402095a316a55ececbe5 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f1/9eb549054785402095a316a55ececbe5 2023-02-07 14:03:01,692 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/.tmp/f1/0ccdb7efcc9d4a4c9f5a753a21facacb as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f1/0ccdb7efcc9d4a4c9f5a753a21facacb 2023-02-07 14:03:01,697 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f1/9eb549054785402095a316a55ececbe5, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 14:03:01,698 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/.tmp/f2/50fc0f0cabf64c0794844cc027d4d85a as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f2/50fc0f0cabf64c0794844cc027d4d85a 2023-02-07 14:03:01,699 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f1/0ccdb7efcc9d4a4c9f5a753a21facacb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:01,700 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/.tmp/f2/0e087b1dd9b6495fa69a7fbc1390bd40 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f2/0e087b1dd9b6495fa69a7fbc1390bd40 2023-02-07 14:03:01,704 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f2/50fc0f0cabf64c0794844cc027d4d85a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 14:03:01,705 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for fbf5e715c5ad5096882efc3afdeb361a in 172ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:01,705 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for fbf5e715c5ad5096882efc3afdeb361a: 2023-02-07 14:03:01,706 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,706 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:01,706 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f1/9eb549054785402095a316a55ececbe5] hfiles 2023-02-07 14:03:01,706 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f1/9eb549054785402095a316a55ececbe5 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,706 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f2/50fc0f0cabf64c0794844cc027d4d85a] hfiles 2023-02-07 14:03:01,706 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f2/50fc0f0cabf64c0794844cc027d4d85a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,709 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f2/0e087b1dd9b6495fa69a7fbc1390bd40, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:01,709 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b29449ae529fdca05cae653bea21a219 in 161ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:01,710 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for b29449ae529fdca05cae653bea21a219: 2023-02-07 14:03:01,710 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,710 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:01,710 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f1/0ccdb7efcc9d4a4c9f5a753a21facacb] hfiles 2023-02-07 14:03:01,710 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f1/0ccdb7efcc9d4a4c9f5a753a21facacb for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,710 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f2/0e087b1dd9b6495fa69a7fbc1390bd40] hfiles 2023-02-07 14:03:01,710 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f2/0e087b1dd9b6495fa69a7fbc1390bd40 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,728 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. completed. 2023-02-07 14:03:01,728 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:01,728 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 14:03:01,733 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. completed. 2023-02-07 14:03:01,733 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:01,734 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 14:03:01,734 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 14:03:01,734 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,734 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-07 14:03:01,734 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,39143,1675778578090' in zk 2023-02-07 14:03:01,736 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,736 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-07 14:03:01,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:01,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:01,737 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:01,737 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-07 14:03:01,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:01,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:01,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:01,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,39143,1675778578090': 2023-02-07 14:03:01,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39143,1675778578090' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-07 14:03:01,741 INFO [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-07 14:03:01,741 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:03:01,741 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:03:01,741 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,741 INFO [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 14:03:01,742 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,742 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,742 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,742 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,742 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:01,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:01,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:01,743 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,744 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:01,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,745 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,746 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,751 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,751 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,752 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,752 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:01,752 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,752 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:01,752 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:01,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion because node does not exist (not an error) 2023-02-07 14:03:01,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:01,752 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:01,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:01,752 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:01,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,752 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:01,753 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:01,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:01,753 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:01,753 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,754 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:01,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:01,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:01,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:01,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-07 14:03:01,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,806 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:01,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675778580823Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675778581753 (+930 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1675778581753Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1675778581763 (+10 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1675778581773 (+10 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1675778581805 (+32 ms) 2023-02-07 14:03:01,807 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 14:03:01,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 983 msec 2023-02-07 14:03:01,934 DEBUG [Listener at localhost/44779] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:01,934 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:01,934 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:01,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 14:03:01,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 14:03:01,936 INFO [Listener at localhost/44779] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 14:03:01,936 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:01,936 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:01,940 INFO [Listener at localhost/44779] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 14:03:01,948 INFO [Listener at localhost/44779] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 14:03:02,222 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38051] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:02,235 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39143] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:02,309 INFO [Listener at localhost/44779] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 14:03:02,313 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:02,313 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:02,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 14:03:02,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-07 14:03:02,319 INFO [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-07 14:03:02,319 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:02,320 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-07 14:03:02,320 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-07 14:03:02,321 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,321 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:02,323 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:02,323 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:02,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:02,324 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:02,324 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,324 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:02,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:02,325 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,325 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:03:02,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:03:02,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:03:02,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:02,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:02,325 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 14:03:02,325 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 14:03:02,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 14:03:02,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 14:03:02,332 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 14:03:02,332 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:02,332 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 14:03:02,333 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 14:03:02,333 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:02,334 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 14:03:02,334 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:02,334 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. started... 2023-02-07 14:03:02,334 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d72c5b2617af9d66aee7e9b65a3c57cf 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 14:03:02,335 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:02,335 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. started... 2023-02-07 14:03:02,335 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b56d417a00b93a9a78fc601a14f3770a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:03:02,335 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:02,335 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. started... 2023-02-07 14:03:02,335 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e13b7676e6adda7db49592ff690641e6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:03:02,336 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:02,336 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. started... 2023-02-07 14:03:02,336 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8cec9d5f1cbe32deb3030b840075b733: 2023-02-07 14:03:02,336 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:02,340 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 14:03:02,350 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:02,350 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. started... 2023-02-07 14:03:02,350 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c594c4d1559bf6f1b8483ad2ed4643c2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:03:02,348 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:02,351 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. started... 2023-02-07 14:03:02,351 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1d96f10cad3fa67966a23bb1d9a51d39: 2023-02-07 14:03:02,351 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:02,351 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:02,352 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. started... 2023-02-07 14:03:02,352 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 73d71a6e15eb7562eeb109ee3a9dbb13 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:03:02,348 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:02,353 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. started... 2023-02-07 14:03:02,353 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing b8b3c36284ccb70b2e6cbad7c3742fd6 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:03:02,348 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 14:03:02,354 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 14:03:02,350 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 14:03:02,354 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 14:03:02,354 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 14:03:02,380 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/.tmp/f1/1c684977afb14bebb20b5221495dc1d3 2023-02-07 14:03:02,413 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/.tmp/f1/eb196ef2af784432bb7ca2d5927fa7d3 2023-02-07 14:03:02,413 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/.tmp/f1/8542826320404f5baef72e735a878fff 2023-02-07 14:03:02,414 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/.tmp/f1/3bd99d7f0e954b248ef79bf44edf6b5a 2023-02-07 14:03:02,432 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/.tmp/f1/c03716eddd274dd2a74f226d89126ba3 2023-02-07 14:03:02,444 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/.tmp/f2/4c066a6baff347358563ecff6e638d5c 2023-02-07 14:03:02,449 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/.tmp/f1/1c684977afb14bebb20b5221495dc1d3 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f1/1c684977afb14bebb20b5221495dc1d3 2023-02-07 14:03:02,455 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f1/1c684977afb14bebb20b5221495dc1d3, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 14:03:02,455 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/.tmp/f2/4c066a6baff347358563ecff6e638d5c as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f2/4c066a6baff347358563ecff6e638d5c 2023-02-07 14:03:02,460 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f2/4c066a6baff347358563ecff6e638d5c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 14:03:02,461 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for d72c5b2617af9d66aee7e9b65a3c57cf in 127ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:02,461 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d72c5b2617af9d66aee7e9b65a3c57cf: 2023-02-07 14:03:02,461 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:02,464 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:02,464 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 14:03:02,464 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. started... 2023-02-07 14:03:02,465 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fbf5e715c5ad5096882efc3afdeb361a 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 14:03:02,474 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/.tmp/f2/a135d3c194564ba9a30483c9a7c65012 2023-02-07 14:03:02,486 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/.tmp/f1/8542826320404f5baef72e735a878fff as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f1/8542826320404f5baef72e735a878fff 2023-02-07 14:03:02,488 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/.tmp/f2/edbf44cc0705468184a88608057bbfcb 2023-02-07 14:03:02,494 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f1/8542826320404f5baef72e735a878fff, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:02,495 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/.tmp/f2/a135d3c194564ba9a30483c9a7c65012 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f2/a135d3c194564ba9a30483c9a7c65012 2023-02-07 14:03:02,496 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/.tmp/f2/953f1f86073f4b5f81fd4df240d23863 2023-02-07 14:03:02,497 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/.tmp/f2/6df38071df3349bc8e27bf00e9c71a63 2023-02-07 14:03:02,498 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/.tmp/f1/eb196ef2af784432bb7ca2d5927fa7d3 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f1/eb196ef2af784432bb7ca2d5927fa7d3 2023-02-07 14:03:02,505 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/.tmp/f1/c03716eddd274dd2a74f226d89126ba3 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f1/c03716eddd274dd2a74f226d89126ba3 2023-02-07 14:03:02,506 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/.tmp/f1/3bd99d7f0e954b248ef79bf44edf6b5a as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f1/3bd99d7f0e954b248ef79bf44edf6b5a 2023-02-07 14:03:02,511 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f1/eb196ef2af784432bb7ca2d5927fa7d3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:02,512 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f2/a135d3c194564ba9a30483c9a7c65012, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:02,512 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/.tmp/f2/edbf44cc0705468184a88608057bbfcb as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f2/edbf44cc0705468184a88608057bbfcb 2023-02-07 14:03:02,513 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c594c4d1559bf6f1b8483ad2ed4643c2 in 163ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:02,513 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c594c4d1559bf6f1b8483ad2ed4643c2: 2023-02-07 14:03:02,514 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:02,514 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:02,514 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. started... 2023-02-07 14:03:02,514 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b29449ae529fdca05cae653bea21a219 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:03:02,514 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 14:03:02,515 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f1/3bd99d7f0e954b248ef79bf44edf6b5a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:02,516 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/.tmp/f2/6df38071df3349bc8e27bf00e9c71a63 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f2/6df38071df3349bc8e27bf00e9c71a63 2023-02-07 14:03:02,517 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/.tmp/f1/9773442c121e4924a975d51c3cbe186e 2023-02-07 14:03:02,518 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f1/c03716eddd274dd2a74f226d89126ba3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:02,520 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/.tmp/f2/953f1f86073f4b5f81fd4df240d23863 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f2/953f1f86073f4b5f81fd4df240d23863 2023-02-07 14:03:02,521 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f2/edbf44cc0705468184a88608057bbfcb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:02,523 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 73d71a6e15eb7562eeb109ee3a9dbb13 in 171ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:02,523 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 73d71a6e15eb7562eeb109ee3a9dbb13: 2023-02-07 14:03:02,523 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:02,524 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 14:03:02,530 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f2/6df38071df3349bc8e27bf00e9c71a63, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:02,531 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b56d417a00b93a9a78fc601a14f3770a in 196ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:02,531 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b56d417a00b93a9a78fc601a14f3770a: 2023-02-07 14:03:02,531 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:02,531 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 14:03:02,534 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f2/953f1f86073f4b5f81fd4df240d23863, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:02,535 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b8b3c36284ccb70b2e6cbad7c3742fd6 in 182ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:02,535 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for b8b3c36284ccb70b2e6cbad7c3742fd6: 2023-02-07 14:03:02,535 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:02,535 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 14:03:02,545 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/.tmp/f1/e2086d33f3784acab60a9a8f7d29f1c5 2023-02-07 14:03:02,558 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/.tmp/f2/30a42aa3ba7349328257747b235070ef 2023-02-07 14:03:02,564 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/.tmp/f1/9773442c121e4924a975d51c3cbe186e as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f1/9773442c121e4924a975d51c3cbe186e 2023-02-07 14:03:02,569 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f1/9773442c121e4924a975d51c3cbe186e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 14:03:02,570 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/.tmp/f2/30a42aa3ba7349328257747b235070ef as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f2/30a42aa3ba7349328257747b235070ef 2023-02-07 14:03:02,571 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/.tmp/f2/adaca0d11412400297fff2c2482d6f83 2023-02-07 14:03:02,576 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f2/30a42aa3ba7349328257747b235070ef, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 14:03:02,577 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for fbf5e715c5ad5096882efc3afdeb361a in 112ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:02,577 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fbf5e715c5ad5096882efc3afdeb361a: 2023-02-07 14:03:02,577 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:02,577 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 14:03:02,581 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/.tmp/f1/e2086d33f3784acab60a9a8f7d29f1c5 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f1/e2086d33f3784acab60a9a8f7d29f1c5 2023-02-07 14:03:02,587 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f1/e2086d33f3784acab60a9a8f7d29f1c5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:02,588 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/.tmp/f2/adaca0d11412400297fff2c2482d6f83 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f2/adaca0d11412400297fff2c2482d6f83 2023-02-07 14:03:02,596 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f2/adaca0d11412400297fff2c2482d6f83, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:02,597 INFO [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b29449ae529fdca05cae653bea21a219 in 83ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:02,597 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b29449ae529fdca05cae653bea21a219: 2023-02-07 14:03:02,597 DEBUG [rs(jenkins-hbase4.apache.org,39143,1675778578090)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:02,597 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 14:03:02,597 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 14:03:02,597 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,597 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 14:03:02,597 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39143,1675778578090' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 14:03:02,599 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:02,599 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:02,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:02,599 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:02,599 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:02,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:02,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:02,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:02,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:02,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39143,1675778578090' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 14:03:02,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c0b86b3[Count = 1] remaining members to acquire global barrier 2023-02-07 14:03:02,812 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/.tmp/f1/0194e2c6d22248109a44232b53c4f155 2023-02-07 14:03:02,825 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/.tmp/f2/d042af7a3cfc4fea9268c2bfa20dbe43 2023-02-07 14:03:02,830 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/.tmp/f1/0194e2c6d22248109a44232b53c4f155 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f1/0194e2c6d22248109a44232b53c4f155 2023-02-07 14:03:02,835 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f1/0194e2c6d22248109a44232b53c4f155, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:02,836 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/.tmp/f2/d042af7a3cfc4fea9268c2bfa20dbe43 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f2/d042af7a3cfc4fea9268c2bfa20dbe43 2023-02-07 14:03:02,840 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f2/d042af7a3cfc4fea9268c2bfa20dbe43, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:02,841 INFO [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e13b7676e6adda7db49592ff690641e6 in 506ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:02,841 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e13b7676e6adda7db49592ff690641e6: 2023-02-07 14:03:02,841 DEBUG [rs(jenkins-hbase4.apache.org,38051,1675778578037)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:02,841 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 14:03:02,841 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 14:03:02,842 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,842 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 14:03:02,842 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38051,1675778578037' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 14:03:02,843 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:02,843 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:02,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:02,844 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:02,844 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:02,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:02,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:02,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:02,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:02,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38051,1675778578037' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 14:03:02,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c0b86b3[Count = 0] remaining members to acquire global barrier 2023-02-07 14:03:02,845 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-07 14:03:02,845 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:02,846 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:02,846 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:02,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:02,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:02,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:02,847 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 14:03:02,847 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:02,847 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 14:03:02,847 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 14:03:02,847 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 14:03:02,847 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,39143,1675778578090' in zk 2023-02-07 14:03:02,847 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38051,1675778578037' in zk 2023-02-07 14:03:02,847 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,847 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:03:02,855 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 14:03:02,855 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,855 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:02,855 DEBUG [member: 'jenkins-hbase4.apache.org,38051,1675778578037' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 14:03:02,856 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 14:03:02,856 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,856 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:02,856 DEBUG [member: 'jenkins-hbase4.apache.org,39143,1675778578090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 14:03:02,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:02,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:02,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:02,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:02,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:02,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38051,1675778578037': 2023-02-07 14:03:02,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38051,1675778578037' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-07 14:03:02,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:02,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:02,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,39143,1675778578090': 2023-02-07 14:03:02,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39143,1675778578090' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-07 14:03:02,862 INFO [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-07 14:03:02,862 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:03:02,862 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:03:02,862 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-07 14:03:02,862 INFO [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 14:03:02,864 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,864 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,864 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:02,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:02,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,864 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:02,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,864 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:02,865 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:02,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:02,865 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,867 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,867 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,870 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:02,870 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,870 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:02,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:02,870 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:02,870 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:02,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-07 14:03:02,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 14:03:02,870 DEBUG [(jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:02,870 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:02,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:02,870 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:02,871 DEBUG [Listener at localhost/44779] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-07 14:03:02,870 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:02,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:02,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:02,871 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testWithMapReduce because node does not exist (not an error) 2023-02-07 14:03:02,871 DEBUG [Listener at localhost/44779] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 14:03:02,872 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:02,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:02,872 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,872 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:02,872 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:02,972 DEBUG [Listener at localhost/44779] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 14:03:02,972 INFO [Listener at localhost/44779] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:02,972 INFO [Listener at localhost/44779] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:02,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42615] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 14:03:02,974 INFO [Listener at localhost/44779] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 14:03:02,974 DEBUG [Listener at localhost/44779] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b106ad8 to 127.0.0.1:49376 2023-02-07 14:03:02,974 DEBUG [Listener at localhost/44779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:02,974 DEBUG [Listener at localhost/44779] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 14:03:02,975 DEBUG [Listener at localhost/44779] util.JVMClusterUtil(257): Found active master hash=221760572, stopped=false 2023-02-07 14:03:02,975 INFO [Listener at localhost/44779] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42615,1675778577928 2023-02-07 14:03:02,978 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:02,978 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:02,978 INFO [Listener at localhost/44779] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 14:03:02,978 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:02,978 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:02,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:02,979 DEBUG [Listener at localhost/44779] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66fa99d5 to 127.0.0.1:49376 2023-02-07 14:03:02,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:02,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:02,980 DEBUG [Listener at localhost/44779] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:02,980 INFO [Listener at localhost/44779] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38051,1675778578037' ***** 2023-02-07 14:03:02,980 INFO [Listener at localhost/44779] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:03:02,980 INFO [Listener at localhost/44779] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39143,1675778578090' ***** 2023-02-07 14:03:02,980 INFO [Listener at localhost/44779] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:03:02,980 INFO [RS:0;jenkins-hbase4:38051] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:03:02,980 INFO [RS:1;jenkins-hbase4:39143] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:03:02,981 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:03:02,981 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:03:02,981 INFO [RS:0;jenkins-hbase4:38051] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:03:02,981 INFO [RS:1;jenkins-hbase4:39143] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:03:02,982 INFO [RS:1;jenkins-hbase4:39143] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:03:02,981 INFO [RS:0;jenkins-hbase4:38051] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:03:02,982 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(3304): Received CLOSE for d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:03:02,982 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(3304): Received CLOSE for e13b7676e6adda7db49592ff690641e6 2023-02-07 14:03:02,982 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(3304): Received CLOSE for b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:03:02,982 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(3304): Received CLOSE for 8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:03:02,982 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(3304): Received CLOSE for 010ec1a2aee7eda29fe7a0a57e2efffd 2023-02-07 14:03:02,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d72c5b2617af9d66aee7e9b65a3c57cf, disabling compactions & flushes 2023-02-07 14:03:02,982 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(3304): Received CLOSE for c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:03:02,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:02,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:02,982 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(3304): Received CLOSE for 1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:03:02,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. after waiting 0 ms 2023-02-07 14:03:02,982 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(3304): Received CLOSE for b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:03:02,982 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(3304): Received CLOSE for fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:03:02,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e13b7676e6adda7db49592ff690641e6, disabling compactions & flushes 2023-02-07 14:03:02,982 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(3304): Received CLOSE for b29449ae529fdca05cae653bea21a219 2023-02-07 14:03:02,982 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(3304): Received CLOSE for 73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:03:02,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:02,983 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:02,983 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:02,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:02,983 DEBUG [RS:1;jenkins-hbase4:39143] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6313eba3 to 127.0.0.1:49376 2023-02-07 14:03:02,983 DEBUG [RS:0;jenkins-hbase4:38051] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d97dda9 to 127.0.0.1:49376 2023-02-07 14:03:02,983 DEBUG [RS:1;jenkins-hbase4:39143] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:02,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:02,983 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-07 14:03:02,983 DEBUG [RS:0;jenkins-hbase4:38051] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:02,983 DEBUG [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(1479): Online Regions={d72c5b2617af9d66aee7e9b65a3c57cf=testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf., b56d417a00b93a9a78fc601a14f3770a=testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a., 010ec1a2aee7eda29fe7a0a57e2efffd=hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd., c594c4d1559bf6f1b8483ad2ed4643c2=testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2., fbf5e715c5ad5096882efc3afdeb361a=testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a., b29449ae529fdca05cae653bea21a219=testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219.} 2023-02-07 14:03:02,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. after waiting 0 ms 2023-02-07 14:03:02,983 INFO [RS:0;jenkins-hbase4:38051] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:03:02,985 DEBUG [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(1505): Waiting on 010ec1a2aee7eda29fe7a0a57e2efffd, b29449ae529fdca05cae653bea21a219, b56d417a00b93a9a78fc601a14f3770a, c594c4d1559bf6f1b8483ad2ed4643c2, d72c5b2617af9d66aee7e9b65a3c57cf, fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:03:02,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:02,986 INFO [RS:0;jenkins-hbase4:38051] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:03:02,987 INFO [RS:0;jenkins-hbase4:38051] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:03:02,987 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 14:03:02,989 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-07 14:03:02,991 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:03:02,991 DEBUG [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(1479): Online Regions={e13b7676e6adda7db49592ff690641e6=testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6., 8cec9d5f1cbe32deb3030b840075b733=testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733., 1588230740=hbase:meta,,1.1588230740, 1d96f10cad3fa67966a23bb1d9a51d39=testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39., b8b3c36284ccb70b2e6cbad7c3742fd6=testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6., 73d71a6e15eb7562eeb109ee3a9dbb13=testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13.} 2023-02-07 14:03:02,991 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:03:02,991 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:03:02,991 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:03:02,991 DEBUG [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(1505): Waiting on 1588230740, 1d96f10cad3fa67966a23bb1d9a51d39, 73d71a6e15eb7562eeb109ee3a9dbb13, 8cec9d5f1cbe32deb3030b840075b733, b8b3c36284ccb70b2e6cbad7c3742fd6, e13b7676e6adda7db49592ff690641e6 2023-02-07 14:03:02,992 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:03:02,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-07 14:03:03,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:03,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:03,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:03,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d72c5b2617af9d66aee7e9b65a3c57cf: Waiting for close lock at 1675778582982Running coprocessor pre-close hooks at 1675778582982Disabling compacts and flushes for region at 1675778582982Disabling writes for close at 1675778582982Writing region close event to WAL at 1675778582991 (+9 ms)Running coprocessor post-close hooks at 1675778583000 (+9 ms)Closed at 1675778583001 (+1 ms) 2023-02-07 14:03:03,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:03,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:03,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e13b7676e6adda7db49592ff690641e6: Waiting for close lock at 1675778582982Running coprocessor pre-close hooks at 1675778582982Disabling compacts and flushes for region at 1675778582982Disabling writes for close at 1675778582985 (+3 ms)Writing region close event to WAL at 1675778582994 (+9 ms)Running coprocessor post-close hooks at 1675778583001 (+7 ms)Closed at 1675778583002 (+1 ms) 2023-02-07 14:03:03,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b56d417a00b93a9a78fc601a14f3770a, disabling compactions & flushes 2023-02-07 14:03:03,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:03,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:03,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:03,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. after waiting 0 ms 2023-02-07 14:03:03,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8cec9d5f1cbe32deb3030b840075b733, disabling compactions & flushes 2023-02-07 14:03:03,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:03,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:03,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:03,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. after waiting 0 ms 2023-02-07 14:03:03,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:03,009 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:03,010 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:03,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/8cec9d5f1cbe32deb3030b840075b733/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 14:03:03,020 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/.tmp/info/2627835585fe443a90840aebd4206ac5 2023-02-07 14:03:03,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:03,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:03,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8cec9d5f1cbe32deb3030b840075b733: Waiting for close lock at 1675778583002Running coprocessor pre-close hooks at 1675778583002Disabling compacts and flushes for region at 1675778583002Disabling writes for close at 1675778583002Writing region close event to WAL at 1675778583002Running coprocessor post-close hooks at 1675778583020 (+18 ms)Closed at 1675778583021 (+1 ms) 2023-02-07 14:03:03,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:03,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1d96f10cad3fa67966a23bb1d9a51d39, disabling compactions & flushes 2023-02-07 14:03:03,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:03,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:03,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b56d417a00b93a9a78fc601a14f3770a: Waiting for close lock at 1675778583002Running coprocessor pre-close hooks at 1675778583002Disabling compacts and flushes for region at 1675778583002Disabling writes for close at 1675778583002Writing region close event to WAL at 1675778583009 (+7 ms)Running coprocessor post-close hooks at 1675778583021 (+12 ms)Closed at 1675778583022 (+1 ms) 2023-02-07 14:03:03,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:03,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. after waiting 0 ms 2023-02-07 14:03:03,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:03,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:03,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 010ec1a2aee7eda29fe7a0a57e2efffd, disabling compactions & flushes 2023-02-07 14:03:03,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. 2023-02-07 14:03:03,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. 2023-02-07 14:03:03,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. after waiting 0 ms 2023-02-07 14:03:03,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. 2023-02-07 14:03:03,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 010ec1a2aee7eda29fe7a0a57e2efffd 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 14:03:03,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/1d96f10cad3fa67966a23bb1d9a51d39/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 14:03:03,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:03,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1d96f10cad3fa67966a23bb1d9a51d39: Waiting for close lock at 1675778583021Running coprocessor pre-close hooks at 1675778583021Disabling compacts and flushes for region at 1675778583021Disabling writes for close at 1675778583022 (+1 ms)Writing region close event to WAL at 1675778583022Running coprocessor post-close hooks at 1675778583027 (+5 ms)Closed at 1675778583028 (+1 ms) 2023-02-07 14:03:03,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:03,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b8b3c36284ccb70b2e6cbad7c3742fd6, disabling compactions & flushes 2023-02-07 14:03:03,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:03,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:03,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. after waiting 0 ms 2023-02-07 14:03:03,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:03,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:03,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:03,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b8b3c36284ccb70b2e6cbad7c3742fd6: Waiting for close lock at 1675778583028Running coprocessor pre-close hooks at 1675778583028Disabling compacts and flushes for region at 1675778583028Disabling writes for close at 1675778583028Writing region close event to WAL at 1675778583049 (+21 ms)Running coprocessor post-close hooks at 1675778583055 (+6 ms)Closed at 1675778583055 2023-02-07 14:03:03,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:03,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 73d71a6e15eb7562eeb109ee3a9dbb13, disabling compactions & flushes 2023-02-07 14:03:03,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:03,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:03,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. after waiting 0 ms 2023-02-07 14:03:03,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:03,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/namespace/010ec1a2aee7eda29fe7a0a57e2efffd/.tmp/info/a6ab2689ab964ee794449ac7516f93d6 2023-02-07 14:03:03,067 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/.tmp/table/87944ae70f304ca58940eca40df60ce4 2023-02-07 14:03:03,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/namespace/010ec1a2aee7eda29fe7a0a57e2efffd/.tmp/info/a6ab2689ab964ee794449ac7516f93d6 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/namespace/010ec1a2aee7eda29fe7a0a57e2efffd/info/a6ab2689ab964ee794449ac7516f93d6 2023-02-07 14:03:03,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:03,074 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/.tmp/info/2627835585fe443a90840aebd4206ac5 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/info/2627835585fe443a90840aebd4206ac5 2023-02-07 14:03:03,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:03,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 73d71a6e15eb7562eeb109ee3a9dbb13: Waiting for close lock at 1675778583056Running coprocessor pre-close hooks at 1675778583056Disabling compacts and flushes for region at 1675778583056Disabling writes for close at 1675778583056Writing region close event to WAL at 1675778583068 (+12 ms)Running coprocessor post-close hooks at 1675778583074 (+6 ms)Closed at 1675778583075 (+1 ms) 2023-02-07 14:03:03,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:03,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/namespace/010ec1a2aee7eda29fe7a0a57e2efffd/info/a6ab2689ab964ee794449ac7516f93d6, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 14:03:03,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 010ec1a2aee7eda29fe7a0a57e2efffd in 60ms, sequenceid=6, compaction requested=false 2023-02-07 14:03:03,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-07 14:03:03,084 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/info/2627835585fe443a90840aebd4206ac5, entries=110, sequenceid=32, filesize=18.7 K 2023-02-07 14:03:03,086 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/.tmp/table/87944ae70f304ca58940eca40df60ce4 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/table/87944ae70f304ca58940eca40df60ce4 2023-02-07 14:03:03,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/namespace/010ec1a2aee7eda29fe7a0a57e2efffd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 14:03:03,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. 2023-02-07 14:03:03,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 010ec1a2aee7eda29fe7a0a57e2efffd: Waiting for close lock at 1675778583022Running coprocessor pre-close hooks at 1675778583022Disabling compacts and flushes for region at 1675778583022Disabling writes for close at 1675778583022Obtaining lock to block concurrent updates at 1675778583022Preparing flush snapshotting stores in 010ec1a2aee7eda29fe7a0a57e2efffd at 1675778583022Finished memstore snapshotting hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675778583023 (+1 ms)Flushing stores of hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. at 1675778583024 (+1 ms)Flushing 010ec1a2aee7eda29fe7a0a57e2efffd/info: creating writer at 1675778583024Flushing 010ec1a2aee7eda29fe7a0a57e2efffd/info: appending metadata at 1675778583026 (+2 ms)Flushing 010ec1a2aee7eda29fe7a0a57e2efffd/info: closing flushed file at 1675778583026Flushing 010ec1a2aee7eda29fe7a0a57e2efffd/info: reopening flushed file at 1675778583072 (+46 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 010ec1a2aee7eda29fe7a0a57e2efffd in 60ms, sequenceid=6, compaction requested=false at 1675778583082 (+10 ms)Writing region close event to WAL at 1675778583083 (+1 ms)Running coprocessor post-close hooks at 1675778583088 (+5 ms)Closed at 1675778583090 (+2 ms) 2023-02-07 14:03:03,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675778578857.010ec1a2aee7eda29fe7a0a57e2efffd. 2023-02-07 14:03:03,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c594c4d1559bf6f1b8483ad2ed4643c2, disabling compactions & flushes 2023-02-07 14:03:03,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:03,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:03,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. after waiting 0 ms 2023-02-07 14:03:03,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:03,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/table/87944ae70f304ca58940eca40df60ce4, entries=4, sequenceid=32, filesize=4.8 K 2023-02-07 14:03:03,094 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 100ms, sequenceid=32, compaction requested=false 2023-02-07 14:03:03,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-07 14:03:03,103 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-07 14:03:03,104 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 14:03:03,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:03,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:03,104 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778582990Running coprocessor pre-close hooks at 1675778582990Disabling compacts and flushes for region at 1675778582990Disabling writes for close at 1675778582992 (+2 ms)Obtaining lock to block concurrent updates at 1675778582994 (+2 ms)Preparing flush snapshotting stores in 1588230740 at 1675778582994Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1675778582994Flushing stores of hbase:meta,,1.1588230740 at 1675778582995 (+1 ms)Flushing 1588230740/info: creating writer at 1675778582995Flushing 1588230740/info: appending metadata at 1675778583000 (+5 ms)Flushing 1588230740/info: closing flushed file at 1675778583000Flushing 1588230740/table: creating writer at 1675778583026 (+26 ms)Flushing 1588230740/table: appending metadata at 1675778583040 (+14 ms)Flushing 1588230740/table: closing flushed file at 1675778583041 (+1 ms)Flushing 1588230740/info: reopening flushed file at 1675778583076 (+35 ms)Flushing 1588230740/table: reopening flushed file at 1675778583086 (+10 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 100ms, sequenceid=32, compaction requested=false at 1675778583094 (+8 ms)Writing region close event to WAL at 1675778583100 (+6 ms)Running coprocessor post-close hooks at 1675778583104 (+4 ms)Closed at 1675778583104 2023-02-07 14:03:03,105 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:03,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:03,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c594c4d1559bf6f1b8483ad2ed4643c2: Waiting for close lock at 1675778583090Running coprocessor pre-close hooks at 1675778583090Disabling compacts and flushes for region at 1675778583090Disabling writes for close at 1675778583090Writing region close event to WAL at 1675778583100 (+10 ms)Running coprocessor post-close hooks at 1675778583105 (+5 ms)Closed at 1675778583105 2023-02-07 14:03:03,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:03,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fbf5e715c5ad5096882efc3afdeb361a, disabling compactions & flushes 2023-02-07 14:03:03,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:03,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:03,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. after waiting 0 ms 2023-02-07 14:03:03,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:03,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:03,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:03,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fbf5e715c5ad5096882efc3afdeb361a: Waiting for close lock at 1675778583105Running coprocessor pre-close hooks at 1675778583105Disabling compacts and flushes for region at 1675778583105Disabling writes for close at 1675778583105Writing region close event to WAL at 1675778583107 (+2 ms)Running coprocessor post-close hooks at 1675778583110 (+3 ms)Closed at 1675778583110 2023-02-07 14:03:03,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:03,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b29449ae529fdca05cae653bea21a219, disabling compactions & flushes 2023-02-07 14:03:03,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:03,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:03,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. after waiting 0 ms 2023-02-07 14:03:03,111 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:03,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:03,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:03,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b29449ae529fdca05cae653bea21a219: Waiting for close lock at 1675778583111Running coprocessor pre-close hooks at 1675778583111Disabling compacts and flushes for region at 1675778583111Disabling writes for close at 1675778583111Writing region close event to WAL at 1675778583113 (+2 ms)Running coprocessor post-close hooks at 1675778583116 (+3 ms)Closed at 1675778583116 2023-02-07 14:03:03,117 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:03,187 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39143,1675778578090; all regions closed. 2023-02-07 14:03:03,192 DEBUG [RS:1;jenkins-hbase4:39143] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/oldWALs 2023-02-07 14:03:03,192 INFO [RS:1;jenkins-hbase4:39143] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39143%2C1675778578090:(num 1675778579236) 2023-02-07 14:03:03,192 DEBUG [RS:1;jenkins-hbase4:39143] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:03,192 INFO [RS:1;jenkins-hbase4:39143] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:03,193 INFO [RS:1;jenkins-hbase4:39143] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 14:03:03,193 INFO [RS:1;jenkins-hbase4:39143] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:03:03,193 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:03,193 INFO [RS:1;jenkins-hbase4:39143] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:03:03,193 INFO [RS:1;jenkins-hbase4:39143] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:03:03,194 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38051,1675778578037; all regions closed. 2023-02-07 14:03:03,194 INFO [RS:1;jenkins-hbase4:39143] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39143 2023-02-07 14:03:03,196 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:03,196 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:03,196 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39143,1675778578090 2023-02-07 14:03:03,196 ERROR [Listener at localhost/44779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@46a19ea rejected from java.util.concurrent.ThreadPoolExecutor@559dbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:03,196 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:03,196 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:03,197 ERROR [Listener at localhost/44779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@20a98e3a rejected from java.util.concurrent.ThreadPoolExecutor@559dbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:03,198 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39143,1675778578090] 2023-02-07 14:03:03,198 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39143,1675778578090; numProcessing=1 2023-02-07 14:03:03,200 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39143,1675778578090 already deleted, retry=false 2023-02-07 14:03:03,200 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39143,1675778578090 expired; onlineServers=1 2023-02-07 14:03:03,203 DEBUG [RS:0;jenkins-hbase4:38051] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/oldWALs 2023-02-07 14:03:03,203 INFO [RS:0;jenkins-hbase4:38051] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38051%2C1675778578037.meta:.meta(num 1675778578778) 2023-02-07 14:03:03,209 DEBUG [RS:0;jenkins-hbase4:38051] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/oldWALs 2023-02-07 14:03:03,209 INFO [RS:0;jenkins-hbase4:38051] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38051%2C1675778578037:(num 1675778579637) 2023-02-07 14:03:03,209 DEBUG [RS:0;jenkins-hbase4:38051] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:03,209 INFO [RS:0;jenkins-hbase4:38051] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:03,209 INFO [RS:0;jenkins-hbase4:38051] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 14:03:03,209 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:03,210 INFO [RS:0;jenkins-hbase4:38051] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38051 2023-02-07 14:03:03,213 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38051,1675778578037 2023-02-07 14:03:03,213 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:03,214 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38051,1675778578037] 2023-02-07 14:03:03,214 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38051,1675778578037; numProcessing=2 2023-02-07 14:03:03,215 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38051,1675778578037 already deleted, retry=false 2023-02-07 14:03:03,215 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38051,1675778578037 expired; onlineServers=0 2023-02-07 14:03:03,215 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42615,1675778577928' ***** 2023-02-07 14:03:03,216 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 14:03:03,217 DEBUG [M:0;jenkins-hbase4:42615] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c0ac607, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:03,217 INFO [M:0;jenkins-hbase4:42615] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42615,1675778577928 2023-02-07 14:03:03,217 INFO [M:0;jenkins-hbase4:42615] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42615,1675778577928; all regions closed. 2023-02-07 14:03:03,217 DEBUG [M:0;jenkins-hbase4:42615] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:03,217 DEBUG [M:0;jenkins-hbase4:42615] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 14:03:03,217 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 14:03:03,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778578358] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778578358,5,FailOnTimeoutGroup] 2023-02-07 14:03:03,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778578358] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778578358,5,FailOnTimeoutGroup] 2023-02-07 14:03:03,217 DEBUG [M:0;jenkins-hbase4:42615] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 14:03:03,218 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:03,218 INFO [M:0;jenkins-hbase4:42615] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 14:03:03,218 INFO [M:0;jenkins-hbase4:42615] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 14:03:03,218 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:03,219 INFO [M:0;jenkins-hbase4:42615] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 14:03:03,219 DEBUG [M:0;jenkins-hbase4:42615] master.HMaster(1502): Stopping service threads 2023-02-07 14:03:03,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:03,219 INFO [M:0;jenkins-hbase4:42615] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 14:03:03,219 ERROR [M:0;jenkins-hbase4:42615] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 14:03:03,219 INFO [M:0;jenkins-hbase4:42615] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 14:03:03,220 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 14:03:03,220 DEBUG [M:0;jenkins-hbase4:42615] zookeeper.ZKUtil(398): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 14:03:03,220 WARN [M:0;jenkins-hbase4:42615] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 14:03:03,220 INFO [M:0;jenkins-hbase4:42615] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 14:03:03,221 INFO [M:0;jenkins-hbase4:42615] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 14:03:03,221 DEBUG [M:0;jenkins-hbase4:42615] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:03:03,221 INFO [M:0;jenkins-hbase4:42615] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:03,221 DEBUG [M:0;jenkins-hbase4:42615] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:03,221 DEBUG [M:0;jenkins-hbase4:42615] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:03:03,221 DEBUG [M:0;jenkins-hbase4:42615] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:03,221 INFO [M:0;jenkins-hbase4:42615] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.95 KB heapSize=120.63 KB 2023-02-07 14:03:03,231 INFO [M:0;jenkins-hbase4:42615] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.95 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/651d9a9fadc5448a8efb4d8fead955b7 2023-02-07 14:03:03,235 DEBUG [M:0;jenkins-hbase4:42615] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/651d9a9fadc5448a8efb4d8fead955b7 as hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/651d9a9fadc5448a8efb4d8fead955b7 2023-02-07 14:03:03,240 INFO [M:0;jenkins-hbase4:42615] regionserver.HStore(1080): Added hdfs://localhost:43565/user/jenkins/test-data/6f775663-5ba4-a7df-7f20-f14c52799897/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/651d9a9fadc5448a8efb4d8fead955b7, entries=31, sequenceid=218, filesize=9.0 K 2023-02-07 14:03:03,241 INFO [M:0;jenkins-hbase4:42615] regionserver.HRegion(2947): Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false 2023-02-07 14:03:03,241 INFO [M:0;jenkins-hbase4:42615] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:03,241 DEBUG [M:0;jenkins-hbase4:42615] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778583221Disabling compacts and flushes for region at 1675778583221Disabling writes for close at 1675778583221Obtaining lock to block concurrent updates at 1675778583221Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675778583221Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103374, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1675778583221Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675778583222 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675778583222Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675778583225 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675778583225Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675778583236 (+11 ms)Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false at 1675778583241 (+5 ms)Writing region close event to WAL at 1675778583241Closed at 1675778583241 2023-02-07 14:03:03,245 INFO [M:0;jenkins-hbase4:42615] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 14:03:03,246 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:03,246 INFO [M:0;jenkins-hbase4:42615] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42615 2023-02-07 14:03:03,251 DEBUG [M:0;jenkins-hbase4:42615] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42615,1675778577928 already deleted, retry=false 2023-02-07 14:03:03,479 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:03,479 INFO [M:0;jenkins-hbase4:42615] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42615,1675778577928; zookeeper connection closed. 2023-02-07 14:03:03,480 ERROR [Listener at localhost/44779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71f14405 rejected from java.util.concurrent.ThreadPoolExecutor@75cecee3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:03,480 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): master:42615-0x1002f17bfaa0000, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:03,480 ERROR [Listener at localhost/44779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a9c6f89 rejected from java.util.concurrent.ThreadPoolExecutor@75cecee3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:03,580 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:03,580 INFO [RS:0;jenkins-hbase4:38051] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38051,1675778578037; zookeeper connection closed. 2023-02-07 14:03:03,580 ERROR [Listener at localhost/44779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e1e754d rejected from java.util.concurrent.ThreadPoolExecutor@1a21f256[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:03,580 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@75ad5cee] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@75ad5cee 2023-02-07 14:03:03,580 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:38051-0x1002f17bfaa0001, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:03,580 ERROR [Listener at localhost/44779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@36fcd1d rejected from java.util.concurrent.ThreadPoolExecutor@1a21f256[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:03,680 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:03,680 INFO [RS:1;jenkins-hbase4:39143] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39143,1675778578090; zookeeper connection closed. 2023-02-07 14:03:03,680 ERROR [Listener at localhost/44779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@584cb5dd rejected from java.util.concurrent.ThreadPoolExecutor@559dbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:03,680 DEBUG [Listener at localhost/44779-EventThread] zookeeper.ZKWatcher(600): regionserver:39143-0x1002f17bfaa0002, quorum=127.0.0.1:49376, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:03,680 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@144f878e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@144f878e 2023-02-07 14:03:03,680 ERROR [Listener at localhost/44779-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@494c7e55 rejected from java.util.concurrent.ThreadPoolExecutor@559dbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:03,681 INFO [Listener at localhost/44779] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 14:03:03,769 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/hadoop-5228257442141235261.jar 2023-02-07 14:03:03,774 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675778580800 type: FLUSH version: 2 ttl: 0 2023-02-07 14:03:03,774 DEBUG [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce 2023-02-07 14:03:03,774 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(239): region to add: d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:03:03,775 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(239): region to add: e13b7676e6adda7db49592ff690641e6 2023-02-07 14:03:03,775 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(239): region to add: 8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:03:03,775 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(239): region to add: b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:03:03,775 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(239): region to add: c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:03:03,775 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(239): region to add: 1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:03:03,775 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(239): region to add: fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:03:03,775 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(239): region to add: b29449ae529fdca05cae653bea21a219 2023-02-07 14:03:03,775 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(239): region to add: b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:03:03,775 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(239): region to add: 73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:03:03,776 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(585): clone region=d72c5b2617af9d66aee7e9b65a3c57cf as d72c5b2617af9d66aee7e9b65a3c57cf in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:03,776 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(585): clone region=e13b7676e6adda7db49592ff690641e6 as e13b7676e6adda7db49592ff690641e6 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:03,776 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(585): clone region=8cec9d5f1cbe32deb3030b840075b733 as 8cec9d5f1cbe32deb3030b840075b733 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:03,776 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(585): clone region=b56d417a00b93a9a78fc601a14f3770a as b56d417a00b93a9a78fc601a14f3770a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:03,776 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(585): clone region=c594c4d1559bf6f1b8483ad2ed4643c2 as c594c4d1559bf6f1b8483ad2ed4643c2 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:03,776 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(585): clone region=1d96f10cad3fa67966a23bb1d9a51d39 as 1d96f10cad3fa67966a23bb1d9a51d39 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:03,776 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(585): clone region=fbf5e715c5ad5096882efc3afdeb361a as fbf5e715c5ad5096882efc3afdeb361a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:03,776 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(585): clone region=b29449ae529fdca05cae653bea21a219 as b29449ae529fdca05cae653bea21a219 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:03,776 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(585): clone region=b8b3c36284ccb70b2e6cbad7c3742fd6 as b8b3c36284ccb70b2e6cbad7c3742fd6 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:03,777 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(585): clone region=73d71a6e15eb7562eeb109ee3a9dbb13 as 73d71a6e15eb7562eeb109ee3a9dbb13 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-07 14:03:03,778 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => e13b7676e6adda7db49592ff690641e6, NAME => 'testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d 2023-02-07 14:03:03,778 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => b56d417a00b93a9a78fc601a14f3770a, NAME => 'testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d 2023-02-07 14:03:03,778 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d72c5b2617af9d66aee7e9b65a3c57cf, NAME => 'testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d 2023-02-07 14:03:03,778 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8cec9d5f1cbe32deb3030b840075b733, NAME => 'testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d 2023-02-07 14:03:03,779 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => c594c4d1559bf6f1b8483ad2ed4643c2, NAME => 'testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d 2023-02-07 14:03:03,779 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 1d96f10cad3fa67966a23bb1d9a51d39, NAME => 'testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d 2023-02-07 14:03:03,780 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => fbf5e715c5ad5096882efc3afdeb361a, NAME => 'testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d 2023-02-07 14:03:03,781 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => b29449ae529fdca05cae653bea21a219, NAME => 'testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d 2023-02-07 14:03:03,804 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:03,804 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 359a9744b8e24db2b6af3091b7d5c4e7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,808 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:03,808 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f08bc78eec0e4c72be0e628e8f4fb8c6 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,828 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:03,828 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:03,828 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 8cec9d5f1cbe32deb3030b840075b733, disabling compactions & flushes 2023-02-07 14:03:03,829 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 35d4965645c543578bfd47a2782a4b95 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,829 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:03,829 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:03,829 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. after waiting 0 ms 2023-02-07 14:03:03,829 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:03,829 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:03,829 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 8cec9d5f1cbe32deb3030b840075b733: Waiting for close lock at 1675778583828Disabling compacts and flushes for region at 1675778583828Disabling writes for close at 1675778583829 (+1 ms)Writing region close event to WAL at 1675778583829Closed at 1675778583829 2023-02-07 14:03:03,829 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => b8b3c36284ccb70b2e6cbad7c3742fd6, NAME => 'testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d 2023-02-07 14:03:03,832 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:03,832 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9eb549054785402095a316a55ececbe5 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,833 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:03,833 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3602e0eedecf4941836bb758315afd57 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,836 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5221476f7c114210bf9cdaa6de98550c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,836 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink becf8417709044c58ec595fab5ad372b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,836 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dc7cbcb67b4847a09817fa9f4eecc52c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,837 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:03,837 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 1d96f10cad3fa67966a23bb1d9a51d39, disabling compactions & flushes 2023-02-07 14:03:03,838 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:03,838 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:03,838 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. after waiting 0 ms 2023-02-07 14:03:03,838 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:03,838 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:03,838 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 1d96f10cad3fa67966a23bb1d9a51d39: Waiting for close lock at 1675778583837Disabling compacts and flushes for region at 1675778583837Disabling writes for close at 1675778583838 (+1 ms)Writing region close event to WAL at 1675778583838Closed at 1675778583838 2023-02-07 14:03:03,838 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 73d71a6e15eb7562eeb109ee3a9dbb13, NAME => 'testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d 2023-02-07 14:03:03,847 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing e13b7676e6adda7db49592ff690641e6, disabling compactions & flushes 2023-02-07 14:03:03,847 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 50fc0f0cabf64c0794844cc027d4d85a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,847 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:03,847 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:03,847 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. after waiting 0 ms 2023-02-07 14:03:03,847 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:03,847 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:03,847 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:03,848 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0ccdb7efcc9d4a4c9f5a753a21facacb from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,848 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for e13b7676e6adda7db49592ff690641e6: Waiting for close lock at 1675778583847Disabling compacts and flushes for region at 1675778583847Disabling writes for close at 1675778583847Writing region close event to WAL at 1675778583847Closed at 1675778583847 2023-02-07 14:03:03,849 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing b56d417a00b93a9a78fc601a14f3770a, disabling compactions & flushes 2023-02-07 14:03:03,849 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:03,849 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:03,849 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. after waiting 0 ms 2023-02-07 14:03:03,849 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:03,849 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:03,849 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for b56d417a00b93a9a78fc601a14f3770a: Waiting for close lock at 1675778583849Disabling compacts and flushes for region at 1675778583849Disabling writes for close at 1675778583849Writing region close event to WAL at 1675778583849Closed at 1675778583849 2023-02-07 14:03:03,849 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d72c5b2617af9d66aee7e9b65a3c57cf, disabling compactions & flushes 2023-02-07 14:03:03,850 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:03,850 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:03,850 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. after waiting 0 ms 2023-02-07 14:03:03,850 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:03,850 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 98e72570a1674bbea9aab469ce05131d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,850 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:03,850 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d72c5b2617af9d66aee7e9b65a3c57cf: Waiting for close lock at 1675778583849Disabling compacts and flushes for region at 1675778583849Disabling writes for close at 1675778583850 (+1 ms)Writing region close event to WAL at 1675778583850Closed at 1675778583850 2023-02-07 14:03:03,851 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0e087b1dd9b6495fa69a7fbc1390bd40 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,852 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing fbf5e715c5ad5096882efc3afdeb361a, disabling compactions & flushes 2023-02-07 14:03:03,852 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:03,852 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:03,853 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. after waiting 0 ms 2023-02-07 14:03:03,853 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:03,853 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:03,853 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for fbf5e715c5ad5096882efc3afdeb361a: Waiting for close lock at 1675778583852Disabling compacts and flushes for region at 1675778583852Disabling writes for close at 1675778583853 (+1 ms)Writing region close event to WAL at 1675778583853Closed at 1675778583853 2023-02-07 14:03:03,853 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing c594c4d1559bf6f1b8483ad2ed4643c2, disabling compactions & flushes 2023-02-07 14:03:03,853 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:03,853 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:03,853 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. after waiting 0 ms 2023-02-07 14:03:03,853 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:03,853 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:03,853 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for c594c4d1559bf6f1b8483ad2ed4643c2: Waiting for close lock at 1675778583853Disabling compacts and flushes for region at 1675778583853Disabling writes for close at 1675778583853Writing region close event to WAL at 1675778583853Closed at 1675778583853 2023-02-07 14:03:03,854 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:03,854 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 15c02e445f7343fdb647ddd354c71bd9 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,855 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing b29449ae529fdca05cae653bea21a219, disabling compactions & flushes 2023-02-07 14:03:03,855 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:03,855 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:03,855 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. after waiting 0 ms 2023-02-07 14:03:03,855 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:03,855 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:03,855 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for b29449ae529fdca05cae653bea21a219: Waiting for close lock at 1675778583855Disabling compacts and flushes for region at 1675778583855Disabling writes for close at 1675778583855Writing region close event to WAL at 1675778583855Closed at 1675778583855 2023-02-07 14:03:03,855 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:03,855 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 94e7ed8907644ac8bba0fb3e9ad3b673 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,857 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9c5103ed9cc44e31a7381e2157aeb365 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,857 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f9ce2e5e5e954d04a8c72a51f19e144f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-07 14:03:03,859 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing b8b3c36284ccb70b2e6cbad7c3742fd6, disabling compactions & flushes 2023-02-07 14:03:03,859 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:03,860 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:03,860 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. after waiting 0 ms 2023-02-07 14:03:03,860 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:03,860 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:03,860 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for b8b3c36284ccb70b2e6cbad7c3742fd6: Waiting for close lock at 1675778583859Disabling compacts and flushes for region at 1675778583859Disabling writes for close at 1675778583860 (+1 ms)Writing region close event to WAL at 1675778583860Closed at 1675778583860 2023-02-07 14:03:03,860 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 73d71a6e15eb7562eeb109ee3a9dbb13, disabling compactions & flushes 2023-02-07 14:03:03,860 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:03,860 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:03,860 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. after waiting 0 ms 2023-02-07 14:03:03,860 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:03,860 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:03,860 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 73d71a6e15eb7562eeb109ee3a9dbb13: Waiting for close lock at 1675778583860Disabling compacts and flushes for region at 1675778583860Disabling writes for close at 1675778583860Writing region close event to WAL at 1675778583860Closed at 1675778583860 2023-02-07 14:03:03,860 INFO [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1675778580800 type: FLUSH version: 2 ttl: 0 2023-02-07 14:03:03,861 DEBUG [Listener at localhost/44779] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d 2023-02-07 14:03:03,861 DEBUG [Listener at localhost/44779] util.CommonFSUtils(682): File system contents for path hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d 2023-02-07 14:03:03,861 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-data/ 2023-02-07 14:03:03,862 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |----default/ 2023-02-07 14:03:03,862 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-07 14:03:03,863 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |----------1d96f10cad3fa67966a23bb1d9a51d39/ 2023-02-07 14:03:03,863 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:03,863 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |----------73d71a6e15eb7562eeb109ee3a9dbb13/ 2023-02-07 14:03:03,864 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:03,864 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:03,864 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=73d71a6e15eb7562eeb109ee3a9dbb13-94e7ed8907644ac8bba0fb3e9ad3b673 2023-02-07 14:03:03,864 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:03,865 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=73d71a6e15eb7562eeb109ee3a9dbb13-f9ce2e5e5e954d04a8c72a51f19e144f 2023-02-07 14:03:03,865 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |----------8cec9d5f1cbe32deb3030b840075b733/ 2023-02-07 14:03:03,865 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:03,865 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |----------b29449ae529fdca05cae653bea21a219/ 2023-02-07 14:03:03,865 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:03,865 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:03,866 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=b29449ae529fdca05cae653bea21a219-0ccdb7efcc9d4a4c9f5a753a21facacb 2023-02-07 14:03:03,866 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:03,866 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=b29449ae529fdca05cae653bea21a219-0e087b1dd9b6495fa69a7fbc1390bd40 2023-02-07 14:03:03,866 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |----------b56d417a00b93a9a78fc601a14f3770a/ 2023-02-07 14:03:03,867 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:03,867 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:03,867 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=b56d417a00b93a9a78fc601a14f3770a-359a9744b8e24db2b6af3091b7d5c4e7 2023-02-07 14:03:03,867 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:03,868 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=b56d417a00b93a9a78fc601a14f3770a-becf8417709044c58ec595fab5ad372b 2023-02-07 14:03:03,868 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |----------b8b3c36284ccb70b2e6cbad7c3742fd6/ 2023-02-07 14:03:03,868 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:03,868 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:03,869 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=b8b3c36284ccb70b2e6cbad7c3742fd6-15c02e445f7343fdb647ddd354c71bd9 2023-02-07 14:03:03,869 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:03,869 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=b8b3c36284ccb70b2e6cbad7c3742fd6-9c5103ed9cc44e31a7381e2157aeb365 2023-02-07 14:03:03,869 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |----------c594c4d1559bf6f1b8483ad2ed4643c2/ 2023-02-07 14:03:03,870 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:03,870 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:03,870 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=c594c4d1559bf6f1b8483ad2ed4643c2-3602e0eedecf4941836bb758315afd57 2023-02-07 14:03:03,870 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:03,871 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=c594c4d1559bf6f1b8483ad2ed4643c2-98e72570a1674bbea9aab469ce05131d 2023-02-07 14:03:03,871 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |----------d72c5b2617af9d66aee7e9b65a3c57cf/ 2023-02-07 14:03:03,871 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:03,871 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:03,872 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=d72c5b2617af9d66aee7e9b65a3c57cf-35d4965645c543578bfd47a2782a4b95 2023-02-07 14:03:03,872 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:03,872 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=d72c5b2617af9d66aee7e9b65a3c57cf-dc7cbcb67b4847a09817fa9f4eecc52c 2023-02-07 14:03:03,872 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |----------e13b7676e6adda7db49592ff690641e6/ 2023-02-07 14:03:03,873 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:03,873 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:03,873 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=e13b7676e6adda7db49592ff690641e6-f08bc78eec0e4c72be0e628e8f4fb8c6 2023-02-07 14:03:03,873 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:03,874 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=e13b7676e6adda7db49592ff690641e6-5221476f7c114210bf9cdaa6de98550c 2023-02-07 14:03:03,874 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |----------fbf5e715c5ad5096882efc3afdeb361a/ 2023-02-07 14:03:03,874 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:03,874 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:03,874 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=fbf5e715c5ad5096882efc3afdeb361a-9eb549054785402095a316a55ececbe5 2023-02-07 14:03:03,874 DEBUG [Listener at localhost/44779] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:03,875 DEBUG [Listener at localhost/44779] util.CommonFSUtils(702): |----------------testWithMapReduce=fbf5e715c5ad5096882efc3afdeb361a-50fc0f0cabf64c0794844cc027d4d85a 2023-02-07 14:03:03,875 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:03,876 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:03,876 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:03,876 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:04,757 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/hadoop-5224455563508852091.jar 2023-02-07 14:03:04,757 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:04,758 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:04,828 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/hadoop-532211615535122515.jar 2023-02-07 14:03:04,829 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:04,829 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:04,830 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:04,830 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:04,831 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:04,831 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:04,831 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-07 14:03:04,832 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-07 14:03:04,832 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-07 14:03:04,832 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-07 14:03:04,833 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-07 14:03:04,833 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-07 14:03:04,834 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-07 14:03:04,834 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-07 14:03:04,834 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-07 14:03:04,835 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-07 14:03:04,835 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:04,836 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 14:03:04,836 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 14:03:04,836 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 14:03:04,837 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 14:03:04,903 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/hadoop-6464814478999471388.jar 2023-02-07 14:03:04,903 DEBUG [Listener at localhost/44779] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 14:03:04,908 WARN [Listener at localhost/44779] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-07 14:03:04,914 WARN [Listener at localhost/44779] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-07 14:03:04,921 INFO [Listener at localhost/44779] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 14:03:05,056 WARN [Listener at localhost/44779] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/mapreduce.cluster.local.dir/1675778585026/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-07 14:03:05,057 WARN [Listener at localhost/44779] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/mapreduce.cluster.local.dir/1675778585026/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-07 14:03:05,105 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:05,105 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:05,106 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:05,107 INFO [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:03:05,109 DEBUG [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/1d96f10cad3fa67966a23bb1d9a51d39/f1 2023-02-07 14:03:05,109 INFO [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d96f10cad3fa67966a23bb1d9a51d39 columnFamilyName f1 2023-02-07 14:03:05,110 INFO [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] regionserver.HStore(310): Store=1d96f10cad3fa67966a23bb1d9a51d39/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,110 INFO [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1d96f10cad3fa67966a23bb1d9a51d39 2023-02-07 14:03:05,111 DEBUG [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/1d96f10cad3fa67966a23bb1d9a51d39/f2 2023-02-07 14:03:05,111 INFO [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d96f10cad3fa67966a23bb1d9a51d39 columnFamilyName f2 2023-02-07 14:03:05,112 INFO [StoreOpener-1d96f10cad3fa67966a23bb1d9a51d39-1] regionserver.HStore(310): Store=1d96f10cad3fa67966a23bb1d9a51d39/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,112 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:05,112 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1d96f10cad3fa67966a23bb1d9a51d39; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67448211, jitterRate=0.005056664347648621}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:05,112 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1d96f10cad3fa67966a23bb1d9a51d39: Writing region info on filesystem at 1675778585106Initializing all the Stores at 1675778585107 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585107Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585107Region opened successfully at 1675778585112 (+5 ms) 2023-02-07 14:03:05,129 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1d96f10cad3fa67966a23bb1d9a51d39, disabling compactions & flushes 2023-02-07 14:03:05,130 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:05,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:05,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. after waiting 0 ms 2023-02-07 14:03:05,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:05,130 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675778579484.1d96f10cad3fa67966a23bb1d9a51d39. 2023-02-07 14:03:05,130 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1d96f10cad3fa67966a23bb1d9a51d39: Waiting for close lock at 1675778585129Disabling compacts and flushes for region at 1675778585129Disabling writes for close at 1675778585130 (+1 ms)Writing region close event to WAL at 1675778585130Closed at 1675778585130 2023-02-07 14:03:05,134 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:05,134 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:05,135 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:05,139 INFO [StoreOpener-b29449ae529fdca05cae653bea21a219-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b29449ae529fdca05cae653bea21a219 2023-02-07 14:03:05,140 DEBUG [StoreOpener-b29449ae529fdca05cae653bea21a219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f1 2023-02-07 14:03:05,140 INFO [StoreOpener-b29449ae529fdca05cae653bea21a219-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b29449ae529fdca05cae653bea21a219 columnFamilyName f1 2023-02-07 14:03:05,145 DEBUG [StoreOpener-b29449ae529fdca05cae653bea21a219-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f1/testWithMapReduce=b29449ae529fdca05cae653bea21a219-0ccdb7efcc9d4a4c9f5a753a21facacb 2023-02-07 14:03:05,145 INFO [StoreOpener-b29449ae529fdca05cae653bea21a219-1] regionserver.HStore(310): Store=b29449ae529fdca05cae653bea21a219/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,146 INFO [StoreOpener-b29449ae529fdca05cae653bea21a219-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b29449ae529fdca05cae653bea21a219 2023-02-07 14:03:05,146 DEBUG [StoreOpener-b29449ae529fdca05cae653bea21a219-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f2 2023-02-07 14:03:05,147 INFO [StoreOpener-b29449ae529fdca05cae653bea21a219-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b29449ae529fdca05cae653bea21a219 columnFamilyName f2 2023-02-07 14:03:05,151 DEBUG [StoreOpener-b29449ae529fdca05cae653bea21a219-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/b29449ae529fdca05cae653bea21a219/f2/testWithMapReduce=b29449ae529fdca05cae653bea21a219-0e087b1dd9b6495fa69a7fbc1390bd40 2023-02-07 14:03:05,151 INFO [StoreOpener-b29449ae529fdca05cae653bea21a219-1] regionserver.HStore(310): Store=b29449ae529fdca05cae653bea21a219/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,151 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:05,152 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b29449ae529fdca05cae653bea21a219; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75083471, jitterRate=0.11883090436458588}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:05,152 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b29449ae529fdca05cae653bea21a219: Writing region info on filesystem at 1675778585135Initializing all the Stores at 1675778585136 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585136Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585138 (+2 ms)Region opened successfully at 1675778585152 (+14 ms) 2023-02-07 14:03:05,181 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b29449ae529fdca05cae653bea21a219, disabling compactions & flushes 2023-02-07 14:03:05,182 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:05,182 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:05,182 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. after waiting 0 ms 2023-02-07 14:03:05,182 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:05,183 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1675778579484.b29449ae529fdca05cae653bea21a219. 2023-02-07 14:03:05,183 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b29449ae529fdca05cae653bea21a219: Waiting for close lock at 1675778585181Disabling compacts and flushes for region at 1675778585181Disabling writes for close at 1675778585182 (+1 ms)Writing region close event to WAL at 1675778585183 (+1 ms)Closed at 1675778585183 2023-02-07 14:03:05,186 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:05,187 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:05,188 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:05,189 INFO [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:03:05,191 DEBUG [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/8cec9d5f1cbe32deb3030b840075b733/f1 2023-02-07 14:03:05,191 INFO [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cec9d5f1cbe32deb3030b840075b733 columnFamilyName f1 2023-02-07 14:03:05,191 INFO [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] regionserver.HStore(310): Store=8cec9d5f1cbe32deb3030b840075b733/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,192 INFO [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8cec9d5f1cbe32deb3030b840075b733 2023-02-07 14:03:05,193 DEBUG [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/8cec9d5f1cbe32deb3030b840075b733/f2 2023-02-07 14:03:05,193 INFO [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cec9d5f1cbe32deb3030b840075b733 columnFamilyName f2 2023-02-07 14:03:05,193 INFO [StoreOpener-8cec9d5f1cbe32deb3030b840075b733-1] regionserver.HStore(310): Store=8cec9d5f1cbe32deb3030b840075b733/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,194 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:05,194 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8cec9d5f1cbe32deb3030b840075b733; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64881288, jitterRate=-0.03319346904754639}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:05,194 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8cec9d5f1cbe32deb3030b840075b733: Writing region info on filesystem at 1675778585188Initializing all the Stores at 1675778585189 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585189Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585189Region opened successfully at 1675778585194 (+5 ms) 2023-02-07 14:03:05,224 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8cec9d5f1cbe32deb3030b840075b733, disabling compactions & flushes 2023-02-07 14:03:05,224 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:05,224 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:05,224 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. after waiting 0 ms 2023-02-07 14:03:05,224 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:05,225 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1675778579484.8cec9d5f1cbe32deb3030b840075b733. 2023-02-07 14:03:05,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8cec9d5f1cbe32deb3030b840075b733: Waiting for close lock at 1675778585224Disabling compacts and flushes for region at 1675778585224Disabling writes for close at 1675778585224Writing region close event to WAL at 1675778585225 (+1 ms)Closed at 1675778585225 2023-02-07 14:03:05,229 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:05,229 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:05,230 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:05,232 INFO [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:03:05,233 DEBUG [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f1 2023-02-07 14:03:05,233 INFO [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73d71a6e15eb7562eeb109ee3a9dbb13 columnFamilyName f1 2023-02-07 14:03:05,240 DEBUG [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f1/testWithMapReduce=73d71a6e15eb7562eeb109ee3a9dbb13-94e7ed8907644ac8bba0fb3e9ad3b673 2023-02-07 14:03:05,240 INFO [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] regionserver.HStore(310): Store=73d71a6e15eb7562eeb109ee3a9dbb13/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,240 INFO [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 73d71a6e15eb7562eeb109ee3a9dbb13 2023-02-07 14:03:05,241 DEBUG [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f2 2023-02-07 14:03:05,241 INFO [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73d71a6e15eb7562eeb109ee3a9dbb13 columnFamilyName f2 2023-02-07 14:03:05,248 DEBUG [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/73d71a6e15eb7562eeb109ee3a9dbb13/f2/testWithMapReduce=73d71a6e15eb7562eeb109ee3a9dbb13-f9ce2e5e5e954d04a8c72a51f19e144f 2023-02-07 14:03:05,248 INFO [StoreOpener-73d71a6e15eb7562eeb109ee3a9dbb13-1] regionserver.HStore(310): Store=73d71a6e15eb7562eeb109ee3a9dbb13/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,248 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:05,248 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 73d71a6e15eb7562eeb109ee3a9dbb13; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67379748, jitterRate=0.0040364861488342285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:05,248 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 73d71a6e15eb7562eeb109ee3a9dbb13: Writing region info on filesystem at 1675778585230Initializing all the Stores at 1675778585231 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585231Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585231Region opened successfully at 1675778585248 (+17 ms) 2023-02-07 14:03:05,283 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 73d71a6e15eb7562eeb109ee3a9dbb13, disabling compactions & flushes 2023-02-07 14:03:05,283 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:05,283 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:05,283 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. after waiting 0 ms 2023-02-07 14:03:05,283 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:05,284 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1675778579484.73d71a6e15eb7562eeb109ee3a9dbb13. 2023-02-07 14:03:05,284 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 73d71a6e15eb7562eeb109ee3a9dbb13: Waiting for close lock at 1675778585283Disabling compacts and flushes for region at 1675778585283Disabling writes for close at 1675778585283Writing region close event to WAL at 1675778585284 (+1 ms)Closed at 1675778585284 2023-02-07 14:03:05,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:05,288 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:05,291 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:05,297 INFO [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:03:05,298 DEBUG [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f1 2023-02-07 14:03:05,298 INFO [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8b3c36284ccb70b2e6cbad7c3742fd6 columnFamilyName f1 2023-02-07 14:03:05,304 DEBUG [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f1/testWithMapReduce=b8b3c36284ccb70b2e6cbad7c3742fd6-15c02e445f7343fdb647ddd354c71bd9 2023-02-07 14:03:05,304 INFO [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] regionserver.HStore(310): Store=b8b3c36284ccb70b2e6cbad7c3742fd6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,304 INFO [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b8b3c36284ccb70b2e6cbad7c3742fd6 2023-02-07 14:03:05,305 DEBUG [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f2 2023-02-07 14:03:05,305 INFO [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8b3c36284ccb70b2e6cbad7c3742fd6 columnFamilyName f2 2023-02-07 14:03:05,312 DEBUG [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/b8b3c36284ccb70b2e6cbad7c3742fd6/f2/testWithMapReduce=b8b3c36284ccb70b2e6cbad7c3742fd6-9c5103ed9cc44e31a7381e2157aeb365 2023-02-07 14:03:05,312 INFO [StoreOpener-b8b3c36284ccb70b2e6cbad7c3742fd6-1] regionserver.HStore(310): Store=b8b3c36284ccb70b2e6cbad7c3742fd6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,313 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:05,313 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b8b3c36284ccb70b2e6cbad7c3742fd6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74618236, jitterRate=0.11189836263656616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:05,313 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b8b3c36284ccb70b2e6cbad7c3742fd6: Writing region info on filesystem at 1675778585291Initializing all the Stores at 1675778585292 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585292Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585296 (+4 ms)Region opened successfully at 1675778585313 (+17 ms) 2023-02-07 14:03:05,341 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b8b3c36284ccb70b2e6cbad7c3742fd6, disabling compactions & flushes 2023-02-07 14:03:05,341 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:05,342 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:05,342 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. after waiting 0 ms 2023-02-07 14:03:05,342 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:05,342 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1675778579484.b8b3c36284ccb70b2e6cbad7c3742fd6. 2023-02-07 14:03:05,342 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b8b3c36284ccb70b2e6cbad7c3742fd6: Waiting for close lock at 1675778585341Disabling compacts and flushes for region at 1675778585341Disabling writes for close at 1675778585342 (+1 ms)Writing region close event to WAL at 1675778585342Closed at 1675778585342 2023-02-07 14:03:05,345 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:05,346 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:05,347 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:05,349 INFO [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:03:05,350 DEBUG [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f1 2023-02-07 14:03:05,351 INFO [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d72c5b2617af9d66aee7e9b65a3c57cf columnFamilyName f1 2023-02-07 14:03:05,355 DEBUG [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f1/testWithMapReduce=d72c5b2617af9d66aee7e9b65a3c57cf-35d4965645c543578bfd47a2782a4b95 2023-02-07 14:03:05,355 INFO [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] regionserver.HStore(310): Store=d72c5b2617af9d66aee7e9b65a3c57cf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,356 INFO [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d72c5b2617af9d66aee7e9b65a3c57cf 2023-02-07 14:03:05,356 DEBUG [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f2 2023-02-07 14:03:05,357 INFO [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d72c5b2617af9d66aee7e9b65a3c57cf columnFamilyName f2 2023-02-07 14:03:05,361 DEBUG [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/d72c5b2617af9d66aee7e9b65a3c57cf/f2/testWithMapReduce=d72c5b2617af9d66aee7e9b65a3c57cf-dc7cbcb67b4847a09817fa9f4eecc52c 2023-02-07 14:03:05,361 INFO [StoreOpener-d72c5b2617af9d66aee7e9b65a3c57cf-1] regionserver.HStore(310): Store=d72c5b2617af9d66aee7e9b65a3c57cf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,361 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:05,361 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d72c5b2617af9d66aee7e9b65a3c57cf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63782080, jitterRate=-0.04957294464111328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:05,361 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d72c5b2617af9d66aee7e9b65a3c57cf: Writing region info on filesystem at 1675778585347Initializing all the Stores at 1675778585348 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585348Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585349 (+1 ms)Region opened successfully at 1675778585361 (+12 ms) 2023-02-07 14:03:05,392 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d72c5b2617af9d66aee7e9b65a3c57cf, disabling compactions & flushes 2023-02-07 14:03:05,392 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:05,392 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:05,392 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. after waiting 0 ms 2023-02-07 14:03:05,392 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:05,393 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1675778579484.d72c5b2617af9d66aee7e9b65a3c57cf. 2023-02-07 14:03:05,393 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d72c5b2617af9d66aee7e9b65a3c57cf: Waiting for close lock at 1675778585392Disabling compacts and flushes for region at 1675778585392Disabling writes for close at 1675778585392Writing region close event to WAL at 1675778585393 (+1 ms)Closed at 1675778585393 2023-02-07 14:03:05,396 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:05,396 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:05,400 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:05,401 INFO [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:03:05,402 DEBUG [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f1 2023-02-07 14:03:05,402 INFO [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c594c4d1559bf6f1b8483ad2ed4643c2 columnFamilyName f1 2023-02-07 14:03:05,407 DEBUG [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f1/testWithMapReduce=c594c4d1559bf6f1b8483ad2ed4643c2-3602e0eedecf4941836bb758315afd57 2023-02-07 14:03:05,407 INFO [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] regionserver.HStore(310): Store=c594c4d1559bf6f1b8483ad2ed4643c2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,407 INFO [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c594c4d1559bf6f1b8483ad2ed4643c2 2023-02-07 14:03:05,407 DEBUG [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f2 2023-02-07 14:03:05,408 INFO [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c594c4d1559bf6f1b8483ad2ed4643c2 columnFamilyName f2 2023-02-07 14:03:05,412 DEBUG [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/c594c4d1559bf6f1b8483ad2ed4643c2/f2/testWithMapReduce=c594c4d1559bf6f1b8483ad2ed4643c2-98e72570a1674bbea9aab469ce05131d 2023-02-07 14:03:05,412 INFO [StoreOpener-c594c4d1559bf6f1b8483ad2ed4643c2-1] regionserver.HStore(310): Store=c594c4d1559bf6f1b8483ad2ed4643c2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:05,412 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c594c4d1559bf6f1b8483ad2ed4643c2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68409810, jitterRate=0.019385606050491333}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:05,412 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c594c4d1559bf6f1b8483ad2ed4643c2: Writing region info on filesystem at 1675778585400Initializing all the Stores at 1675778585401 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585401Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585401Region opened successfully at 1675778585412 (+11 ms) 2023-02-07 14:03:05,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c594c4d1559bf6f1b8483ad2ed4643c2, disabling compactions & flushes 2023-02-07 14:03:05,446 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:05,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:05,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. after waiting 0 ms 2023-02-07 14:03:05,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:05,447 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1675778579484.c594c4d1559bf6f1b8483ad2ed4643c2. 2023-02-07 14:03:05,447 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c594c4d1559bf6f1b8483ad2ed4643c2: Waiting for close lock at 1675778585446Disabling compacts and flushes for region at 1675778585446Disabling writes for close at 1675778585446Writing region close event to WAL at 1675778585447 (+1 ms)Closed at 1675778585447 2023-02-07 14:03:05,450 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:05,450 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:05,451 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:05,453 INFO [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:03:05,453 DEBUG [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f1 2023-02-07 14:03:05,454 INFO [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbf5e715c5ad5096882efc3afdeb361a columnFamilyName f1 2023-02-07 14:03:05,459 DEBUG [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f1/testWithMapReduce=fbf5e715c5ad5096882efc3afdeb361a-9eb549054785402095a316a55ececbe5 2023-02-07 14:03:05,460 INFO [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] regionserver.HStore(310): Store=fbf5e715c5ad5096882efc3afdeb361a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,460 INFO [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region fbf5e715c5ad5096882efc3afdeb361a 2023-02-07 14:03:05,461 DEBUG [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f2 2023-02-07 14:03:05,461 INFO [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbf5e715c5ad5096882efc3afdeb361a columnFamilyName f2 2023-02-07 14:03:05,465 DEBUG [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/fbf5e715c5ad5096882efc3afdeb361a/f2/testWithMapReduce=fbf5e715c5ad5096882efc3afdeb361a-50fc0f0cabf64c0794844cc027d4d85a 2023-02-07 14:03:05,465 INFO [StoreOpener-fbf5e715c5ad5096882efc3afdeb361a-1] regionserver.HStore(310): Store=fbf5e715c5ad5096882efc3afdeb361a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,465 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:05,465 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened fbf5e715c5ad5096882efc3afdeb361a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62304192, jitterRate=-0.0715951919555664}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:05,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for fbf5e715c5ad5096882efc3afdeb361a: Writing region info on filesystem at 1675778585451Initializing all the Stores at 1675778585452 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585452Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585452Region opened successfully at 1675778585466 (+14 ms) 2023-02-07 14:03:05,494 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing fbf5e715c5ad5096882efc3afdeb361a, disabling compactions & flushes 2023-02-07 14:03:05,494 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:05,494 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:05,494 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. after waiting 0 ms 2023-02-07 14:03:05,494 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:05,495 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1675778579484.fbf5e715c5ad5096882efc3afdeb361a. 2023-02-07 14:03:05,495 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for fbf5e715c5ad5096882efc3afdeb361a: Waiting for close lock at 1675778585494Disabling compacts and flushes for region at 1675778585494Disabling writes for close at 1675778585494Writing region close event to WAL at 1675778585495 (+1 ms)Closed at 1675778585495 2023-02-07 14:03:05,498 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:05,498 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:05,499 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:05,501 INFO [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:03:05,502 DEBUG [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f1 2023-02-07 14:03:05,502 INFO [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b56d417a00b93a9a78fc601a14f3770a columnFamilyName f1 2023-02-07 14:03:05,507 DEBUG [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f1/testWithMapReduce=b56d417a00b93a9a78fc601a14f3770a-359a9744b8e24db2b6af3091b7d5c4e7 2023-02-07 14:03:05,507 INFO [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] regionserver.HStore(310): Store=b56d417a00b93a9a78fc601a14f3770a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,507 INFO [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b56d417a00b93a9a78fc601a14f3770a 2023-02-07 14:03:05,508 DEBUG [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f2 2023-02-07 14:03:05,508 INFO [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b56d417a00b93a9a78fc601a14f3770a columnFamilyName f2 2023-02-07 14:03:05,513 DEBUG [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/b56d417a00b93a9a78fc601a14f3770a/f2/testWithMapReduce=b56d417a00b93a9a78fc601a14f3770a-becf8417709044c58ec595fab5ad372b 2023-02-07 14:03:05,513 INFO [StoreOpener-b56d417a00b93a9a78fc601a14f3770a-1] regionserver.HStore(310): Store=b56d417a00b93a9a78fc601a14f3770a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,513 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:05,513 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b56d417a00b93a9a78fc601a14f3770a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69107330, jitterRate=0.02977946400642395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:05,513 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b56d417a00b93a9a78fc601a14f3770a: Writing region info on filesystem at 1675778585499Initializing all the Stores at 1675778585500 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585500Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585500Region opened successfully at 1675778585513 (+13 ms) 2023-02-07 14:03:05,548 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b56d417a00b93a9a78fc601a14f3770a, disabling compactions & flushes 2023-02-07 14:03:05,549 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:05,549 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:05,549 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. after waiting 0 ms 2023-02-07 14:03:05,549 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:05,550 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1675778579484.b56d417a00b93a9a78fc601a14f3770a. 2023-02-07 14:03:05,550 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b56d417a00b93a9a78fc601a14f3770a: Waiting for close lock at 1675778585548Disabling compacts and flushes for region at 1675778585548Disabling writes for close at 1675778585549 (+1 ms)Writing region close event to WAL at 1675778585550 (+1 ms)Closed at 1675778585550 2023-02-07 14:03:05,553 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:05,553 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:05,554 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:05,557 INFO [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e13b7676e6adda7db49592ff690641e6 2023-02-07 14:03:05,558 DEBUG [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f1 2023-02-07 14:03:05,558 INFO [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e13b7676e6adda7db49592ff690641e6 columnFamilyName f1 2023-02-07 14:03:05,562 DEBUG [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f1/testWithMapReduce=e13b7676e6adda7db49592ff690641e6-f08bc78eec0e4c72be0e628e8f4fb8c6 2023-02-07 14:03:05,563 INFO [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] regionserver.HStore(310): Store=e13b7676e6adda7db49592ff690641e6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,563 INFO [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e13b7676e6adda7db49592ff690641e6 2023-02-07 14:03:05,564 DEBUG [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f2 2023-02-07 14:03:05,564 INFO [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e13b7676e6adda7db49592ff690641e6 columnFamilyName f2 2023-02-07 14:03:05,568 DEBUG [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] regionserver.HStore(539): loaded hdfs://localhost:43565/user/jenkins/test-data/8ca9cf33-0064-8acc-f8a4-c778c41fc350/testWithMapReduceAndOfflineHBaseMultiRegion/2748ef76-b106-49af-856f-7c2349223f7d/data/default/testWithMapReduce/e13b7676e6adda7db49592ff690641e6/f2/testWithMapReduce=e13b7676e6adda7db49592ff690641e6-5221476f7c114210bf9cdaa6de98550c 2023-02-07 14:03:05,569 INFO [StoreOpener-e13b7676e6adda7db49592ff690641e6-1] regionserver.HStore(310): Store=e13b7676e6adda7db49592ff690641e6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:05,569 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:05,570 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e13b7676e6adda7db49592ff690641e6; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67218852, jitterRate=0.001638948917388916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:05,570 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e13b7676e6adda7db49592ff690641e6: Writing region info on filesystem at 1675778585554Initializing all the Stores at 1675778585555 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585555Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778585555Region opened successfully at 1675778585570 (+15 ms) 2023-02-07 14:03:05,603 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e13b7676e6adda7db49592ff690641e6, disabling compactions & flushes 2023-02-07 14:03:05,603 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:05,603 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:05,604 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. after waiting 0 ms 2023-02-07 14:03:05,604 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:05,604 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1675778579484.e13b7676e6adda7db49592ff690641e6. 2023-02-07 14:03:05,604 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e13b7676e6adda7db49592ff690641e6: Waiting for close lock at 1675778585603Disabling compacts and flushes for region at 1675778585603Disabling writes for close at 1675778585604 (+1 ms)Writing region close event to WAL at 1675778585604Closed at 1675778585604 2023-02-07 14:03:05,809 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 14:03:06,106 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 14:03:06,106 WARN [Listener at localhost/44779] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:03:06,109 INFO [Listener at localhost/44779] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:06,216 WARN [BP-1521572396-172.31.14.131-1675778577220 heartbeating to localhost/127.0.0.1:43565] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 14:03:06,216 WARN [BP-1521572396-172.31.14.131-1675778577220 heartbeating to localhost/127.0.0.1:43565] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1521572396-172.31.14.131-1675778577220 (Datanode Uuid 1e607a47-a81f-44c1-b30c-10186d589e86) service to localhost/127.0.0.1:43565 2023-02-07 14:03:06,217 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/cluster_e48f5955-c744-2f89-e38a-b1af473ed45e/dfs/data/data3/current/BP-1521572396-172.31.14.131-1675778577220] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:06,217 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/cluster_e48f5955-c744-2f89-e38a-b1af473ed45e/dfs/data/data4/current/BP-1521572396-172.31.14.131-1675778577220] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:06,218 WARN [Listener at localhost/44779] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:03:06,221 INFO [Listener at localhost/44779] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:06,323 WARN [BP-1521572396-172.31.14.131-1675778577220 heartbeating to localhost/127.0.0.1:43565] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 14:03:06,323 WARN [BP-1521572396-172.31.14.131-1675778577220 heartbeating to localhost/127.0.0.1:43565] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1521572396-172.31.14.131-1675778577220 (Datanode Uuid a6f9cc03-dfeb-4719-983f-ff4a77b2347b) service to localhost/127.0.0.1:43565 2023-02-07 14:03:06,324 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/cluster_e48f5955-c744-2f89-e38a-b1af473ed45e/dfs/data/data1/current/BP-1521572396-172.31.14.131-1675778577220] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:06,324 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/cluster_e48f5955-c744-2f89-e38a-b1af473ed45e/dfs/data/data2/current/BP-1521572396-172.31.14.131-1675778577220] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:06,335 INFO [Listener at localhost/44779] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:06,455 INFO [Listener at localhost/44779] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 14:03:06,501 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 14:03:06,514 INFO [Listener at localhost/44779] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=154 (was 104) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:43565 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:43565 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:43565 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:43565 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42615,1675778577928)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:43565 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:43565 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44779 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:43565 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=538 (was 538), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=266 (was 277), ProcessCount=166 (was 166), AvailableMemoryMB=5544 (was 5680) 2023-02-07 14:03:06,524 INFO [Listener at localhost/44779] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=154, OpenFileDescriptor=538, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=166, AvailableMemoryMB=5543 2023-02-07 14:03:06,534 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/hadoop.log.dir so I do NOT create it in target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240 2023-02-07 14:03:06,534 WARN [Listener at localhost/44779] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 14:03:06,534 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/hadoop.tmp.dir so I do NOT create it in target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240 2023-02-07 14:03:06,535 WARN [Listener at localhost/44779] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5c59ad78-fe42-dcb0-f30e-e19db147aeab/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 14:03:06,535 DEBUG [Listener at localhost/44779] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240 2023-02-07 14:03:06,535 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 14:03:06,535 INFO [Listener at localhost/44779] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/cluster_148e837b-4781-2289-0a4e-0066806282c7, deleteOnExit=true 2023-02-07 14:03:06,535 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 14:03:06,535 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/test.cache.data in system properties and HBase conf 2023-02-07 14:03:06,535 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 14:03:06,535 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/hadoop.log.dir in system properties and HBase conf 2023-02-07 14:03:06,535 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 14:03:06,535 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 14:03:06,535 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 14:03:06,536 DEBUG [Listener at localhost/44779] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 14:03:06,536 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:03:06,536 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:03:06,536 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 14:03:06,536 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:03:06,536 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 14:03:06,536 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 14:03:06,536 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:03:06,536 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:03:06,537 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 14:03:06,537 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/nfs.dump.dir in system properties and HBase conf 2023-02-07 14:03:06,537 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/java.io.tmpdir in system properties and HBase conf 2023-02-07 14:03:06,537 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:03:06,537 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 14:03:06,537 INFO [Listener at localhost/44779] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 14:03:06,550 WARN [Listener at localhost/44779] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:03:06,550 WARN [Listener at localhost/44779] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:03:06,588 WARN [Listener at localhost/44779] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:06,590 INFO [Listener at localhost/44779] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:06,596 INFO [Listener at localhost/44779] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/java.io.tmpdir/Jetty_localhost_45829_hdfs____.vuz4zc/webapp 2023-02-07 14:03:06,687 INFO [Listener at localhost/44779] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45829 2023-02-07 14:03:06,691 WARN [Listener at localhost/44779] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:03:06,691 WARN [Listener at localhost/44779] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:03:06,729 WARN [Listener at localhost/35183] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:06,744 WARN [Listener at localhost/35183] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:03:06,746 WARN [Listener at localhost/35183] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:06,747 INFO [Listener at localhost/35183] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:06,752 INFO [Listener at localhost/35183] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/java.io.tmpdir/Jetty_localhost_34335_datanode____.hk9w79/webapp 2023-02-07 14:03:06,846 INFO [Listener at localhost/35183] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34335 2023-02-07 14:03:06,854 WARN [Listener at localhost/36111] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:06,870 WARN [Listener at localhost/36111] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:03:06,872 WARN [Listener at localhost/36111] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:06,873 INFO [Listener at localhost/36111] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:06,876 INFO [Listener at localhost/36111] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/java.io.tmpdir/Jetty_localhost_41367_datanode____.4n14oy/webapp 2023-02-07 14:03:06,953 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x17402358098bb8e: Processing first storage report for DS-1d4665d7-63e4-41ed-8baa-da6716d5f507 from datanode 8792b3f1-ebfe-48f9-93f9-c12acf0f1ea5 2023-02-07 14:03:06,954 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x17402358098bb8e: from storage DS-1d4665d7-63e4-41ed-8baa-da6716d5f507 node DatanodeRegistration(127.0.0.1:36951, datanodeUuid=8792b3f1-ebfe-48f9-93f9-c12acf0f1ea5, infoPort=41417, infoSecurePort=0, ipcPort=36111, storageInfo=lv=-57;cid=testClusterID;nsid=1692690405;c=1675778586553), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-07 14:03:06,954 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x17402358098bb8e: Processing first storage report for DS-d1f1b5aa-924e-4dc0-947f-456e4c6ea36a from datanode 8792b3f1-ebfe-48f9-93f9-c12acf0f1ea5 2023-02-07 14:03:06,954 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x17402358098bb8e: from storage DS-d1f1b5aa-924e-4dc0-947f-456e4c6ea36a node DatanodeRegistration(127.0.0.1:36951, datanodeUuid=8792b3f1-ebfe-48f9-93f9-c12acf0f1ea5, infoPort=41417, infoSecurePort=0, ipcPort=36111, storageInfo=lv=-57;cid=testClusterID;nsid=1692690405;c=1675778586553), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:06,976 INFO [Listener at localhost/36111] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41367 2023-02-07 14:03:06,986 WARN [Listener at localhost/38171] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:07,093 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x16fa833a5293bb93: Processing first storage report for DS-0a1db709-4bc1-44c2-8fee-7d88cc65d40b from datanode d3381372-d43d-4605-aa52-0ee78b5d7b06 2023-02-07 14:03:07,093 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x16fa833a5293bb93: from storage DS-0a1db709-4bc1-44c2-8fee-7d88cc65d40b node DatanodeRegistration(127.0.0.1:40407, datanodeUuid=d3381372-d43d-4605-aa52-0ee78b5d7b06, infoPort=46729, infoSecurePort=0, ipcPort=38171, storageInfo=lv=-57;cid=testClusterID;nsid=1692690405;c=1675778586553), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:07,093 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x16fa833a5293bb93: Processing first storage report for DS-f61ac7f0-4b03-4a81-886c-d628f96163ce from datanode d3381372-d43d-4605-aa52-0ee78b5d7b06 2023-02-07 14:03:07,093 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x16fa833a5293bb93: from storage DS-f61ac7f0-4b03-4a81-886c-d628f96163ce node DatanodeRegistration(127.0.0.1:40407, datanodeUuid=d3381372-d43d-4605-aa52-0ee78b5d7b06, infoPort=46729, infoSecurePort=0, ipcPort=38171, storageInfo=lv=-57;cid=testClusterID;nsid=1692690405;c=1675778586553), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:07,095 DEBUG [Listener at localhost/38171] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240 2023-02-07 14:03:07,097 INFO [Listener at localhost/38171] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/cluster_148e837b-4781-2289-0a4e-0066806282c7/zookeeper_0, clientPort=57122, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/cluster_148e837b-4781-2289-0a4e-0066806282c7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/cluster_148e837b-4781-2289-0a4e-0066806282c7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 14:03:07,098 INFO [Listener at localhost/38171] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57122 2023-02-07 14:03:07,099 INFO [Listener at localhost/38171] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:07,099 INFO [Listener at localhost/38171] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:07,110 INFO [Listener at localhost/38171] util.FSUtils(479): Created version file at hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978 with version=8 2023-02-07 14:03:07,110 INFO [Listener at localhost/38171] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:07,111 INFO [Listener at localhost/38171] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:07,112 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35183/user/jenkins/test-data/1c6d8e59-b180-781d-4b0c-0b635469df4c/hbase-staging 2023-02-07 14:03:07,114 INFO [Listener at localhost/38171] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:07,114 INFO [Listener at localhost/38171] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:07,114 INFO [Listener at localhost/38171] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:07,114 INFO [Listener at localhost/38171] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:07,114 INFO [Listener at localhost/38171] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:07,114 INFO [Listener at localhost/38171] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:07,114 INFO [Listener at localhost/38171] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:07,116 INFO [Listener at localhost/38171] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37375 2023-02-07 14:03:07,116 INFO [Listener at localhost/38171] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:07,117 INFO [Listener at localhost/38171] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:07,117 INFO [Listener at localhost/38171] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37375 connecting to ZooKeeper ensemble=127.0.0.1:57122 2023-02-07 14:03:07,128 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:373750x0, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:07,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37375-0x1002f17e39e0000 connected 2023-02-07 14:03:07,148 DEBUG [Listener at localhost/38171] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:07,148 DEBUG [Listener at localhost/38171] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:07,148 DEBUG [Listener at localhost/38171] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:07,149 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37375 2023-02-07 14:03:07,150 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37375 2023-02-07 14:03:07,152 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37375 2023-02-07 14:03:07,156 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37375 2023-02-07 14:03:07,156 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37375 2023-02-07 14:03:07,156 INFO [Listener at localhost/38171] master.HMaster(439): hbase.rootdir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978, hbase.cluster.distributed=false 2023-02-07 14:03:07,172 INFO [Listener at localhost/38171] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:07,173 INFO [Listener at localhost/38171] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:07,173 INFO [Listener at localhost/38171] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:07,173 INFO [Listener at localhost/38171] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:07,173 INFO [Listener at localhost/38171] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:07,173 INFO [Listener at localhost/38171] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:07,173 INFO [Listener at localhost/38171] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:07,175 INFO [Listener at localhost/38171] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45179 2023-02-07 14:03:07,175 INFO [Listener at localhost/38171] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:03:07,176 DEBUG [Listener at localhost/38171] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:07,176 INFO [Listener at localhost/38171] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:07,177 INFO [Listener at localhost/38171] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:07,178 INFO [Listener at localhost/38171] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45179 connecting to ZooKeeper ensemble=127.0.0.1:57122 2023-02-07 14:03:07,181 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:451790x0, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:07,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45179-0x1002f17e39e0001 connected 2023-02-07 14:03:07,184 DEBUG [Listener at localhost/38171] zookeeper.ZKUtil(164): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:07,184 DEBUG [Listener at localhost/38171] zookeeper.ZKUtil(164): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:07,185 DEBUG [Listener at localhost/38171] zookeeper.ZKUtil(164): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:07,188 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45179 2023-02-07 14:03:07,188 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45179 2023-02-07 14:03:07,188 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45179 2023-02-07 14:03:07,189 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45179 2023-02-07 14:03:07,190 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45179 2023-02-07 14:03:07,200 INFO [Listener at localhost/38171] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:07,201 INFO [Listener at localhost/38171] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:07,201 INFO [Listener at localhost/38171] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:07,201 INFO [Listener at localhost/38171] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:07,201 INFO [Listener at localhost/38171] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:07,201 INFO [Listener at localhost/38171] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:07,201 INFO [Listener at localhost/38171] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:07,205 INFO [Listener at localhost/38171] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46503 2023-02-07 14:03:07,205 INFO [Listener at localhost/38171] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:03:07,208 DEBUG [Listener at localhost/38171] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:07,209 INFO [Listener at localhost/38171] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:07,210 INFO [Listener at localhost/38171] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:07,210 INFO [Listener at localhost/38171] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46503 connecting to ZooKeeper ensemble=127.0.0.1:57122 2023-02-07 14:03:07,215 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:465030x0, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:07,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46503-0x1002f17e39e0002 connected 2023-02-07 14:03:07,217 DEBUG [Listener at localhost/38171] zookeeper.ZKUtil(164): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:07,217 DEBUG [Listener at localhost/38171] zookeeper.ZKUtil(164): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:07,218 DEBUG [Listener at localhost/38171] zookeeper.ZKUtil(164): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:07,218 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46503 2023-02-07 14:03:07,220 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46503 2023-02-07 14:03:07,220 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46503 2023-02-07 14:03:07,225 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46503 2023-02-07 14:03:07,225 DEBUG [Listener at localhost/38171] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46503 2023-02-07 14:03:07,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37375,1675778587113 2023-02-07 14:03:07,228 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:03:07,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37375,1675778587113 2023-02-07 14:03:07,229 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:07,229 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:07,229 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:07,229 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:07,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:03:07,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37375,1675778587113 from backup master directory 2023-02-07 14:03:07,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:03:07,233 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37375,1675778587113 2023-02-07 14:03:07,233 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:03:07,233 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:07,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37375,1675778587113 2023-02-07 14:03:07,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/hbase.id with ID: c9d4be93-396d-493e-a182-288da3cf0b50 2023-02-07 14:03:07,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:07,265 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:07,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x031fc8db to 127.0.0.1:57122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:07,279 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12317437, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:07,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:07,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 14:03:07,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:07,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/MasterData/data/master/store-tmp 2023-02-07 14:03:07,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:07,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:03:07,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:07,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:07,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:03:07,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:07,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:07,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778587692Disabling compacts and flushes for region at 1675778587692Disabling writes for close at 1675778587692Writing region close event to WAL at 1675778587692Closed at 1675778587692 2023-02-07 14:03:07,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/MasterData/WALs/jenkins-hbase4.apache.org,37375,1675778587113 2023-02-07 14:03:07,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37375%2C1675778587113, suffix=, logDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/MasterData/WALs/jenkins-hbase4.apache.org,37375,1675778587113, archiveDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/MasterData/oldWALs, maxLogs=10 2023-02-07 14:03:07,710 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36951,DS-1d4665d7-63e4-41ed-8baa-da6716d5f507,DISK] 2023-02-07 14:03:07,711 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40407,DS-0a1db709-4bc1-44c2-8fee-7d88cc65d40b,DISK] 2023-02-07 14:03:07,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/MasterData/WALs/jenkins-hbase4.apache.org,37375,1675778587113/jenkins-hbase4.apache.org%2C37375%2C1675778587113.1675778587696 2023-02-07 14:03:07,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36951,DS-1d4665d7-63e4-41ed-8baa-da6716d5f507,DISK], DatanodeInfoWithStorage[127.0.0.1:40407,DS-0a1db709-4bc1-44c2-8fee-7d88cc65d40b,DISK]] 2023-02-07 14:03:07,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:07,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:07,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:07,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:07,721 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:07,722 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 14:03:07,722 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 14:03:07,723 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:07,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:07,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:07,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:07,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:07,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61681101, jitterRate=-0.08087997138500214}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:03:07,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675778587716Initializing all the Stores at 1675778587717 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778587717Cleaning up temporary data from old regions at 1675778587724 (+7 ms)Cleaning up detritus from prior splits at 1675778587725 (+1 ms)Region opened successfully at 1675778587732 (+7 ms) 2023-02-07 14:03:07,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 14:03:07,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 14:03:07,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 14:03:07,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 14:03:07,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 14:03:07,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 14:03:07,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 14:03:07,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 14:03:07,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 14:03:07,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 14:03:07,747 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 14:03:07,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 14:03:07,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 14:03:07,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 14:03:07,750 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:07,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 14:03:07,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 14:03:07,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 14:03:07,753 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:07,753 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:07,753 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:07,753 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:07,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37375,1675778587113, sessionid=0x1002f17e39e0000, setting cluster-up flag (Was=false) 2023-02-07 14:03:07,758 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:07,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 14:03:07,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37375,1675778587113 2023-02-07 14:03:07,765 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:07,769 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 14:03:07,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37375,1675778587113 2023-02-07 14:03:07,770 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.hbase-snapshot/.tmp 2023-02-07 14:03:07,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:07,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:07,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:07,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:07,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:07,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 14:03:07,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:07,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675778617773 2023-02-07 14:03:07,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 14:03:07,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 14:03:07,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 14:03:07,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 14:03:07,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 14:03:07,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 14:03:07,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,774 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:07,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 14:03:07,774 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 14:03:07,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 14:03:07,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 14:03:07,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 14:03:07,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 14:03:07,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778587775,5,FailOnTimeoutGroup] 2023-02-07 14:03:07,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778587775,5,FailOnTimeoutGroup] 2023-02-07 14:03:07,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 14:03:07,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,775 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:07,828 INFO [RS:0;jenkins-hbase4:45179] regionserver.HRegionServer(952): ClusterId : c9d4be93-396d-493e-a182-288da3cf0b50 2023-02-07 14:03:07,828 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(952): ClusterId : c9d4be93-396d-493e-a182-288da3cf0b50 2023-02-07 14:03:07,828 DEBUG [RS:0;jenkins-hbase4:45179] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:03:07,828 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:03:07,829 DEBUG [RS:0;jenkins-hbase4:45179] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:03:07,830 DEBUG [RS:0;jenkins-hbase4:45179] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:03:07,829 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:03:07,830 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:03:07,832 DEBUG [RS:0;jenkins-hbase4:45179] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:03:07,833 DEBUG [RS:0;jenkins-hbase4:45179] zookeeper.ReadOnlyZKClient(139): Connect 0x32d4fa02 to 127.0.0.1:57122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:07,833 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:03:07,835 DEBUG [RS:1;jenkins-hbase4:46503] zookeeper.ReadOnlyZKClient(139): Connect 0x17c51dd0 to 127.0.0.1:57122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:07,844 DEBUG [RS:0;jenkins-hbase4:45179] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c131228, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:07,844 DEBUG [RS:0;jenkins-hbase4:45179] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@382c9172, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:07,844 DEBUG [RS:1;jenkins-hbase4:46503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1902f158, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:07,844 DEBUG [RS:1;jenkins-hbase4:46503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d3d76a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:07,853 DEBUG [RS:0;jenkins-hbase4:45179] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45179 2023-02-07 14:03:07,853 INFO [RS:0;jenkins-hbase4:45179] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:03:07,853 INFO [RS:0;jenkins-hbase4:45179] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:03:07,853 DEBUG [RS:0;jenkins-hbase4:45179] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:03:07,854 INFO [RS:0;jenkins-hbase4:45179] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37375,1675778587113 with isa=jenkins-hbase4.apache.org/172.31.14.131:45179, startcode=1675778587172 2023-02-07 14:03:07,854 DEBUG [RS:0;jenkins-hbase4:45179] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:03:07,856 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46827, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:03:07,856 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46503 2023-02-07 14:03:07,856 INFO [RS:1;jenkins-hbase4:46503] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:03:07,856 INFO [RS:1;jenkins-hbase4:46503] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:03:07,856 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:03:07,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:07,858 DEBUG [RS:0;jenkins-hbase4:45179] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978 2023-02-07 14:03:07,858 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37375,1675778587113 with isa=jenkins-hbase4.apache.org/172.31.14.131:46503, startcode=1675778587200 2023-02-07 14:03:07,858 DEBUG [RS:0;jenkins-hbase4:45179] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35183 2023-02-07 14:03:07,858 DEBUG [RS:0;jenkins-hbase4:45179] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:03:07,858 DEBUG [RS:1;jenkins-hbase4:46503] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:03:07,859 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:07,860 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53317, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:03:07,860 DEBUG [RS:0;jenkins-hbase4:45179] zookeeper.ZKUtil(162): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:07,860 WARN [RS:0;jenkins-hbase4:45179] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:07,860 INFO [RS:0;jenkins-hbase4:45179] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:07,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:07,860 DEBUG [RS:0;jenkins-hbase4:45179] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/WALs/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:07,861 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45179,1675778587172] 2023-02-07 14:03:07,861 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978 2023-02-07 14:03:07,861 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35183 2023-02-07 14:03:07,861 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:03:07,866 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:07,866 DEBUG [RS:1;jenkins-hbase4:46503] zookeeper.ZKUtil(162): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:07,866 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46503,1675778587200] 2023-02-07 14:03:07,866 WARN [RS:1;jenkins-hbase4:46503] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:07,866 INFO [RS:1;jenkins-hbase4:46503] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:07,866 DEBUG [RS:0;jenkins-hbase4:45179] zookeeper.ZKUtil(162): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:07,866 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/WALs/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:07,866 DEBUG [RS:0;jenkins-hbase4:45179] zookeeper.ZKUtil(162): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:07,868 DEBUG [RS:0;jenkins-hbase4:45179] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:03:07,869 INFO [RS:0;jenkins-hbase4:45179] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:03:07,870 DEBUG [RS:1;jenkins-hbase4:46503] zookeeper.ZKUtil(162): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:07,870 DEBUG [RS:1;jenkins-hbase4:46503] zookeeper.ZKUtil(162): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:07,871 INFO [RS:0;jenkins-hbase4:45179] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:03:07,871 INFO [RS:0;jenkins-hbase4:45179] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:03:07,871 INFO [RS:0;jenkins-hbase4:45179] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,871 INFO [RS:0;jenkins-hbase4:45179] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:03:07,872 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:03:07,872 INFO [RS:1;jenkins-hbase4:46503] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:03:07,872 INFO [RS:0;jenkins-hbase4:45179] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,873 DEBUG [RS:0;jenkins-hbase4:45179] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,873 DEBUG [RS:0;jenkins-hbase4:45179] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,873 DEBUG [RS:0;jenkins-hbase4:45179] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,873 DEBUG [RS:0;jenkins-hbase4:45179] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,873 DEBUG [RS:0;jenkins-hbase4:45179] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,873 DEBUG [RS:0;jenkins-hbase4:45179] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:07,873 DEBUG [RS:0;jenkins-hbase4:45179] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,873 DEBUG [RS:0;jenkins-hbase4:45179] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,874 DEBUG [RS:0;jenkins-hbase4:45179] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,874 DEBUG [RS:0;jenkins-hbase4:45179] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,876 INFO [RS:1;jenkins-hbase4:46503] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:03:07,878 INFO [RS:1;jenkins-hbase4:46503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:03:07,878 INFO [RS:0;jenkins-hbase4:45179] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,878 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,878 INFO [RS:0;jenkins-hbase4:45179] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,878 INFO [RS:0;jenkins-hbase4:45179] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,880 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:03:07,881 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,881 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,881 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,881 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,881 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,881 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,881 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:07,881 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,881 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,881 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,881 DEBUG [RS:1;jenkins-hbase4:46503] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:07,888 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,888 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,888 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,895 INFO [RS:0;jenkins-hbase4:45179] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:03:07,895 INFO [RS:0;jenkins-hbase4:45179] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45179,1675778587172-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,898 INFO [RS:1;jenkins-hbase4:46503] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:03:07,898 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46503,1675778587200-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:07,909 INFO [RS:1;jenkins-hbase4:46503] regionserver.Replication(203): jenkins-hbase4.apache.org,46503,1675778587200 started 2023-02-07 14:03:07,909 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46503,1675778587200, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46503, sessionid=0x1002f17e39e0002 2023-02-07 14:03:07,909 INFO [RS:0;jenkins-hbase4:45179] regionserver.Replication(203): jenkins-hbase4.apache.org,45179,1675778587172 started 2023-02-07 14:03:07,909 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:03:07,909 DEBUG [RS:1;jenkins-hbase4:46503] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:07,909 DEBUG [RS:1;jenkins-hbase4:46503] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46503,1675778587200' 2023-02-07 14:03:07,909 INFO [RS:0;jenkins-hbase4:45179] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45179,1675778587172, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45179, sessionid=0x1002f17e39e0001 2023-02-07 14:03:07,909 DEBUG [RS:1;jenkins-hbase4:46503] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:07,909 DEBUG [RS:0;jenkins-hbase4:45179] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:03:07,909 DEBUG [RS:0;jenkins-hbase4:45179] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:07,910 DEBUG [RS:0;jenkins-hbase4:45179] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45179,1675778587172' 2023-02-07 14:03:07,910 DEBUG [RS:0;jenkins-hbase4:45179] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:07,910 DEBUG [RS:1;jenkins-hbase4:46503] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:07,910 DEBUG [RS:0;jenkins-hbase4:45179] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:07,910 DEBUG [RS:0;jenkins-hbase4:45179] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:03:07,910 DEBUG [RS:0;jenkins-hbase4:45179] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:03:07,910 DEBUG [RS:0;jenkins-hbase4:45179] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:07,910 DEBUG [RS:0;jenkins-hbase4:45179] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45179,1675778587172' 2023-02-07 14:03:07,910 DEBUG [RS:0;jenkins-hbase4:45179] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:07,910 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:03:07,910 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:03:07,910 DEBUG [RS:1;jenkins-hbase4:46503] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:07,911 DEBUG [RS:1;jenkins-hbase4:46503] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46503,1675778587200' 2023-02-07 14:03:07,911 DEBUG [RS:1;jenkins-hbase4:46503] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:07,911 DEBUG [RS:0;jenkins-hbase4:45179] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:07,911 DEBUG [RS:1;jenkins-hbase4:46503] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:07,911 DEBUG [RS:0;jenkins-hbase4:45179] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:03:07,911 INFO [RS:0;jenkins-hbase4:45179] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:03:07,911 INFO [RS:0;jenkins-hbase4:45179] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:03:07,911 DEBUG [RS:1;jenkins-hbase4:46503] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:03:07,911 INFO [RS:1;jenkins-hbase4:46503] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:03:07,911 INFO [RS:1;jenkins-hbase4:46503] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:03:08,188 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:08,188 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:08,188 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978 2023-02-07 14:03:08,195 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:08,196 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:03:08,197 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/info 2023-02-07 14:03:08,198 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:03:08,198 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:08,198 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:03:08,199 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:08,200 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:03:08,200 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:08,200 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:03:08,201 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/table 2023-02-07 14:03:08,201 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:03:08,202 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:08,202 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740 2023-02-07 14:03:08,203 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740 2023-02-07 14:03:08,205 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:03:08,205 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:03:08,207 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:08,207 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68460559, jitterRate=0.020141825079917908}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:03:08,207 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675778588195Initializing all the Stores at 1675778588196 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778588196Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778588196Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778588196Cleaning up temporary data from old regions at 1675778588204 (+8 ms)Cleaning up detritus from prior splits at 1675778588204Region opened successfully at 1675778588207 (+3 ms) 2023-02-07 14:03:08,208 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:03:08,208 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:03:08,208 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:03:08,208 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:03:08,208 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:03:08,208 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:08,208 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778588208Disabling compacts and flushes for region at 1675778588208Disabling writes for close at 1675778588208Writing region close event to WAL at 1675778588208Closed at 1675778588208 2023-02-07 14:03:08,209 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:08,209 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 14:03:08,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 14:03:08,211 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 14:03:08,212 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 14:03:08,362 DEBUG [jenkins-hbase4:37375] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 14:03:08,362 DEBUG [jenkins-hbase4:37375] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:08,364 DEBUG [jenkins-hbase4:37375] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:08,364 DEBUG [jenkins-hbase4:37375] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:08,364 DEBUG [jenkins-hbase4:37375] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:08,365 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46503,1675778587200, state=OPENING 2023-02-07 14:03:08,367 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 14:03:08,368 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:08,368 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:03:08,368 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46503,1675778587200}] 2023-02-07 14:03:08,522 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:08,522 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 14:03:08,524 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51658, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 14:03:08,528 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 14:03:08,528 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:08,529 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46503%2C1675778587200.meta, suffix=.meta, logDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/WALs/jenkins-hbase4.apache.org,46503,1675778587200, archiveDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/oldWALs, maxLogs=32 2023-02-07 14:03:08,544 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40407,DS-0a1db709-4bc1-44c2-8fee-7d88cc65d40b,DISK] 2023-02-07 14:03:08,544 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36951,DS-1d4665d7-63e4-41ed-8baa-da6716d5f507,DISK] 2023-02-07 14:03:08,546 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/WALs/jenkins-hbase4.apache.org,46503,1675778587200/jenkins-hbase4.apache.org%2C46503%2C1675778587200.meta.1675778588530.meta 2023-02-07 14:03:08,546 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36951,DS-1d4665d7-63e4-41ed-8baa-da6716d5f507,DISK], DatanodeInfoWithStorage[127.0.0.1:40407,DS-0a1db709-4bc1-44c2-8fee-7d88cc65d40b,DISK]] 2023-02-07 14:03:08,547 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:08,547 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 14:03:08,547 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 14:03:08,547 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 14:03:08,547 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 14:03:08,547 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:08,547 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 14:03:08,547 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 14:03:08,548 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:03:08,549 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/info 2023-02-07 14:03:08,549 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/info 2023-02-07 14:03:08,550 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:03:08,550 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:08,550 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:03:08,551 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:08,551 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:08,551 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:03:08,552 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:08,552 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:03:08,552 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/table 2023-02-07 14:03:08,552 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/table 2023-02-07 14:03:08,553 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:03:08,553 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:08,554 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740 2023-02-07 14:03:08,555 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740 2023-02-07 14:03:08,557 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:03:08,558 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:03:08,558 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69217116, jitterRate=0.03141540288925171}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:03:08,558 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675778588547Writing region info on filesystem at 1675778588547Initializing all the Stores at 1675778588548 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778588548Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778588548Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778588548Cleaning up temporary data from old regions at 1675778588556 (+8 ms)Cleaning up detritus from prior splits at 1675778588556Running coprocessor post-open hooks at 1675778588558 (+2 ms)Region opened successfully at 1675778588558 2023-02-07 14:03:08,559 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675778588522 2023-02-07 14:03:08,562 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 14:03:08,563 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 14:03:08,563 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46503,1675778587200, state=OPEN 2023-02-07 14:03:08,564 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 14:03:08,564 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:03:08,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 14:03:08,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46503,1675778587200 in 196 msec 2023-02-07 14:03:08,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 14:03:08,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 357 msec 2023-02-07 14:03:08,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 797 msec 2023-02-07 14:03:08,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675778587228, completionTime=-1 2023-02-07 14:03:08,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 14:03:08,569 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 14:03:08,572 DEBUG [hconnection-0x16e6fbaf-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:08,573 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51660, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:08,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 14:03:08,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675778648574 2023-02-07 14:03:08,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675778708575 2023-02-07 14:03:08,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-07 14:03:08,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37375,1675778587113-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:08,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37375,1675778587113-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:08,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37375,1675778587113-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:08,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37375, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:08,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:08,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 14:03:08,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:08,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 14:03:08,585 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 14:03:08,585 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:03:08,586 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:03:08,588 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/hbase/namespace/e12e853763830a7cca85efa8cedec3b0 2023-02-07 14:03:08,588 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/hbase/namespace/e12e853763830a7cca85efa8cedec3b0 empty. 2023-02-07 14:03:08,588 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/hbase/namespace/e12e853763830a7cca85efa8cedec3b0 2023-02-07 14:03:08,588 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 14:03:08,607 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:08,608 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e12e853763830a7cca85efa8cedec3b0, NAME => 'hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp 2023-02-07 14:03:08,617 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:08,618 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e12e853763830a7cca85efa8cedec3b0, disabling compactions & flushes 2023-02-07 14:03:08,618 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. 2023-02-07 14:03:08,618 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. 2023-02-07 14:03:08,618 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. after waiting 0 ms 2023-02-07 14:03:08,618 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. 2023-02-07 14:03:08,618 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. 2023-02-07 14:03:08,618 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e12e853763830a7cca85efa8cedec3b0: Waiting for close lock at 1675778588618Disabling compacts and flushes for region at 1675778588618Disabling writes for close at 1675778588618Writing region close event to WAL at 1675778588618Closed at 1675778588618 2023-02-07 14:03:08,620 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:03:08,621 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778588621"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778588621"}]},"ts":"1675778588621"} 2023-02-07 14:03:08,622 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 14:03:08,623 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:03:08,623 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778588623"}]},"ts":"1675778588623"} 2023-02-07 14:03:08,625 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 14:03:08,628 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:08,629 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:08,629 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:08,629 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:08,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e12e853763830a7cca85efa8cedec3b0, ASSIGN}] 2023-02-07 14:03:08,631 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e12e853763830a7cca85efa8cedec3b0, ASSIGN 2023-02-07 14:03:08,632 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e12e853763830a7cca85efa8cedec3b0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46503,1675778587200; forceNewPlan=false, retain=false 2023-02-07 14:03:08,782 INFO [jenkins-hbase4:37375] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 14:03:08,783 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e12e853763830a7cca85efa8cedec3b0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:08,784 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778588783"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778588783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778588783"}]},"ts":"1675778588783"} 2023-02-07 14:03:08,786 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e12e853763830a7cca85efa8cedec3b0, server=jenkins-hbase4.apache.org,46503,1675778587200}] 2023-02-07 14:03:08,913 INFO [RS:0;jenkins-hbase4:45179] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45179%2C1675778587172, suffix=, logDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/WALs/jenkins-hbase4.apache.org,45179,1675778587172, archiveDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/oldWALs, maxLogs=32 2023-02-07 14:03:08,913 INFO [RS:1;jenkins-hbase4:46503] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46503%2C1675778587200, suffix=, logDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/WALs/jenkins-hbase4.apache.org,46503,1675778587200, archiveDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/oldWALs, maxLogs=32 2023-02-07 14:03:08,928 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36951,DS-1d4665d7-63e4-41ed-8baa-da6716d5f507,DISK] 2023-02-07 14:03:08,929 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40407,DS-0a1db709-4bc1-44c2-8fee-7d88cc65d40b,DISK] 2023-02-07 14:03:08,931 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36951,DS-1d4665d7-63e4-41ed-8baa-da6716d5f507,DISK] 2023-02-07 14:03:08,931 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40407,DS-0a1db709-4bc1-44c2-8fee-7d88cc65d40b,DISK] 2023-02-07 14:03:08,932 INFO [RS:1;jenkins-hbase4:46503] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/WALs/jenkins-hbase4.apache.org,46503,1675778587200/jenkins-hbase4.apache.org%2C46503%2C1675778587200.1675778588914 2023-02-07 14:03:08,935 DEBUG [RS:1;jenkins-hbase4:46503] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36951,DS-1d4665d7-63e4-41ed-8baa-da6716d5f507,DISK], DatanodeInfoWithStorage[127.0.0.1:40407,DS-0a1db709-4bc1-44c2-8fee-7d88cc65d40b,DISK]] 2023-02-07 14:03:08,935 INFO [RS:0;jenkins-hbase4:45179] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/WALs/jenkins-hbase4.apache.org,45179,1675778587172/jenkins-hbase4.apache.org%2C45179%2C1675778587172.1675778588913 2023-02-07 14:03:08,935 DEBUG [RS:0;jenkins-hbase4:45179] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36951,DS-1d4665d7-63e4-41ed-8baa-da6716d5f507,DISK], DatanodeInfoWithStorage[127.0.0.1:40407,DS-0a1db709-4bc1-44c2-8fee-7d88cc65d40b,DISK]] 2023-02-07 14:03:08,940 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. 2023-02-07 14:03:08,940 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e12e853763830a7cca85efa8cedec3b0, NAME => 'hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:08,940 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e12e853763830a7cca85efa8cedec3b0 2023-02-07 14:03:08,940 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:08,940 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e12e853763830a7cca85efa8cedec3b0 2023-02-07 14:03:08,940 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e12e853763830a7cca85efa8cedec3b0 2023-02-07 14:03:08,941 INFO [StoreOpener-e12e853763830a7cca85efa8cedec3b0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e12e853763830a7cca85efa8cedec3b0 2023-02-07 14:03:08,942 DEBUG [StoreOpener-e12e853763830a7cca85efa8cedec3b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/namespace/e12e853763830a7cca85efa8cedec3b0/info 2023-02-07 14:03:08,942 DEBUG [StoreOpener-e12e853763830a7cca85efa8cedec3b0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/namespace/e12e853763830a7cca85efa8cedec3b0/info 2023-02-07 14:03:08,943 INFO [StoreOpener-e12e853763830a7cca85efa8cedec3b0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e12e853763830a7cca85efa8cedec3b0 columnFamilyName info 2023-02-07 14:03:08,943 INFO [StoreOpener-e12e853763830a7cca85efa8cedec3b0-1] regionserver.HStore(310): Store=e12e853763830a7cca85efa8cedec3b0/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:08,944 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/namespace/e12e853763830a7cca85efa8cedec3b0 2023-02-07 14:03:08,944 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/namespace/e12e853763830a7cca85efa8cedec3b0 2023-02-07 14:03:08,946 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e12e853763830a7cca85efa8cedec3b0 2023-02-07 14:03:08,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/namespace/e12e853763830a7cca85efa8cedec3b0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:08,948 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e12e853763830a7cca85efa8cedec3b0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65432205, jitterRate=-0.024984166026115417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:03:08,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e12e853763830a7cca85efa8cedec3b0: Running coprocessor pre-open hook at 1675778588940Writing region info on filesystem at 1675778588940Initializing all the Stores at 1675778588941 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778588941Cleaning up temporary data from old regions at 1675778588944 (+3 ms)Cleaning up detritus from prior splits at 1675778588945 (+1 ms)Running coprocessor post-open hooks at 1675778588948 (+3 ms)Region opened successfully at 1675778588948 2023-02-07 14:03:08,949 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0., pid=6, masterSystemTime=1675778588937 2023-02-07 14:03:08,950 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. 2023-02-07 14:03:08,950 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. 2023-02-07 14:03:08,951 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e12e853763830a7cca85efa8cedec3b0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:08,951 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778588951"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778588951"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778588951"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778588951"}]},"ts":"1675778588951"} 2023-02-07 14:03:08,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 14:03:08,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e12e853763830a7cca85efa8cedec3b0, server=jenkins-hbase4.apache.org,46503,1675778587200 in 166 msec 2023-02-07 14:03:08,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 14:03:08,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e12e853763830a7cca85efa8cedec3b0, ASSIGN in 325 msec 2023-02-07 14:03:08,956 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:03:08,956 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778588956"}]},"ts":"1675778588956"} 2023-02-07 14:03:08,957 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 14:03:08,960 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:03:08,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 378 msec 2023-02-07 14:03:08,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 14:03:08,986 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:08,986 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:08,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 14:03:08,998 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:09,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-07 14:03:09,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 14:03:09,019 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:09,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-07 14:03:09,036 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 14:03:09,039 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 14:03:09,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.806sec 2023-02-07 14:03:09,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 14:03:09,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 14:03:09,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 14:03:09,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37375,1675778587113-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 14:03:09,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37375,1675778587113-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 14:03:09,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 14:03:09,129 DEBUG [Listener at localhost/38171] zookeeper.ReadOnlyZKClient(139): Connect 0x1438893e to 127.0.0.1:57122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:09,134 DEBUG [Listener at localhost/38171] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ff61c86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:09,136 DEBUG [hconnection-0x53d51750-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:09,138 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51668, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:09,139 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37375,1675778587113 2023-02-07 14:03:09,139 DEBUG [Listener at localhost/38171] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 14:03:09,139 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:09,139 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:09,142 DEBUG [Listener at localhost/38171] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 14:03:09,144 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55434, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 14:03:09,145 INFO [Listener at localhost/38171] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:09,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:09,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 14:03:09,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 97 connection: 172.31.14.131:55434 deadline: 1675778649145, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:09,146 INFO [Listener at localhost/38171] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-07 14:03:09,146 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:09,147 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:09,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:09,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:09,151 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:03:09,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-07 14:03:09,151 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:09,152 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:09,152 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:03:09,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:09,153 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:09,154 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051 empty. 2023-02-07 14:03:09,154 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:09,154 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-07 14:03:09,165 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:09,166 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 426539f5d38cbea190ebcdbc25104051, NAME => 'testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp 2023-02-07 14:03:09,178 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:09,178 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 426539f5d38cbea190ebcdbc25104051, disabling compactions & flushes 2023-02-07 14:03:09,178 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:09,178 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:09,179 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. after waiting 0 ms 2023-02-07 14:03:09,179 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:09,179 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:09,179 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 426539f5d38cbea190ebcdbc25104051: Waiting for close lock at 1675778589178Disabling compacts and flushes for region at 1675778589178Disabling writes for close at 1675778589179 (+1 ms)Writing region close event to WAL at 1675778589179Closed at 1675778589179 2023-02-07 14:03:09,181 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:03:09,182 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675778589182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778589182"}]},"ts":"1675778589182"} 2023-02-07 14:03:09,183 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 14:03:09,184 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:03:09,184 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778589184"}]},"ts":"1675778589184"} 2023-02-07 14:03:09,185 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-07 14:03:09,190 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:09,191 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:09,191 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:09,191 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:09,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=426539f5d38cbea190ebcdbc25104051, ASSIGN}] 2023-02-07 14:03:09,193 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=426539f5d38cbea190ebcdbc25104051, ASSIGN 2023-02-07 14:03:09,194 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=426539f5d38cbea190ebcdbc25104051, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46503,1675778587200; forceNewPlan=false, retain=false 2023-02-07 14:03:09,253 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:09,253 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:09,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:09,344 INFO [jenkins-hbase4:37375] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 14:03:09,346 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=426539f5d38cbea190ebcdbc25104051, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:09,346 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675778589346"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778589346"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778589346"}]},"ts":"1675778589346"} 2023-02-07 14:03:09,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 426539f5d38cbea190ebcdbc25104051, server=jenkins-hbase4.apache.org,46503,1675778587200}] 2023-02-07 14:03:09,455 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:09,455 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:09,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:09,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:09,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 426539f5d38cbea190ebcdbc25104051, NAME => 'testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:09,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:09,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:09,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:09,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:09,504 INFO [StoreOpener-426539f5d38cbea190ebcdbc25104051-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:09,505 DEBUG [StoreOpener-426539f5d38cbea190ebcdbc25104051-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f1 2023-02-07 14:03:09,505 DEBUG [StoreOpener-426539f5d38cbea190ebcdbc25104051-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f1 2023-02-07 14:03:09,506 INFO [StoreOpener-426539f5d38cbea190ebcdbc25104051-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 426539f5d38cbea190ebcdbc25104051 columnFamilyName f1 2023-02-07 14:03:09,506 INFO [StoreOpener-426539f5d38cbea190ebcdbc25104051-1] regionserver.HStore(310): Store=426539f5d38cbea190ebcdbc25104051/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:09,506 INFO [StoreOpener-426539f5d38cbea190ebcdbc25104051-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:09,508 DEBUG [StoreOpener-426539f5d38cbea190ebcdbc25104051-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f2 2023-02-07 14:03:09,508 DEBUG [StoreOpener-426539f5d38cbea190ebcdbc25104051-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f2 2023-02-07 14:03:09,509 INFO [StoreOpener-426539f5d38cbea190ebcdbc25104051-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 426539f5d38cbea190ebcdbc25104051 columnFamilyName f2 2023-02-07 14:03:09,509 INFO [StoreOpener-426539f5d38cbea190ebcdbc25104051-1] regionserver.HStore(310): Store=426539f5d38cbea190ebcdbc25104051/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:09,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:09,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:09,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:09,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:09,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:09,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 426539f5d38cbea190ebcdbc25104051; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74748665, jitterRate=0.11384190618991852}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:09,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 426539f5d38cbea190ebcdbc25104051: Running coprocessor pre-open hook at 1675778589503Writing region info on filesystem at 1675778589503Initializing all the Stores at 1675778589504 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778589504Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778589504Cleaning up temporary data from old regions at 1675778589511 (+7 ms)Cleaning up detritus from prior splits at 1675778589511Running coprocessor post-open hooks at 1675778589515 (+4 ms)Region opened successfully at 1675778589515 2023-02-07 14:03:09,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051., pid=12, masterSystemTime=1675778589499 2023-02-07 14:03:09,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:09,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:09,518 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=426539f5d38cbea190ebcdbc25104051, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:09,518 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675778589518"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778589518"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778589518"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778589518"}]},"ts":"1675778589518"} 2023-02-07 14:03:09,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-07 14:03:09,521 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 426539f5d38cbea190ebcdbc25104051, server=jenkins-hbase4.apache.org,46503,1675778587200 in 172 msec 2023-02-07 14:03:09,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-07 14:03:09,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=426539f5d38cbea190ebcdbc25104051, ASSIGN in 329 msec 2023-02-07 14:03:09,523 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:03:09,523 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778589523"}]},"ts":"1675778589523"} 2023-02-07 14:03:09,524 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-07 14:03:09,527 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:03:09,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 379 msec 2023-02-07 14:03:09,757 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:09,757 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:09,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:09,759 INFO [Listener at localhost/38171] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-07 14:03:09,759 DEBUG [Listener at localhost/38171] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-07 14:03:09,759 INFO [Listener at localhost/38171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:03:09,761 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-07 14:03:09,761 INFO [Listener at localhost/38171] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:03:09,761 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-07 14:03:09,761 INFO [Listener at localhost/38171] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 14:03:09,826 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46503] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:09,935 INFO [Listener at localhost/38171] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 14:03:09,935 INFO [Listener at localhost/38171] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 14:03:09,935 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:09,935 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:09,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-07 14:03:09,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675778589937 (current time:1675778589937). 2023-02-07 14:03:09,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 14:03:09,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] zookeeper.ReadOnlyZKClient(139): Connect 0x3fff9f41 to 127.0.0.1:57122 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:09,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a5656e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:09,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:09,945 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51682, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:09,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fff9f41 to 127.0.0.1:57122 2023-02-07 14:03:09,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:09,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 14:03:09,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-07 14:03:09,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-07 14:03:09,950 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-07 14:03:09,951 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1675779189951 2023-02-07 14:03:09,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-07 14:03:09,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:09,952 DEBUG [Listener at localhost/38171] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 14:03:09,952 DEBUG [Listener at localhost/38171] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 14:03:09,953 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-07 14:03:09,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-07 14:03:09,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-07 14:03:09,957 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-07 14:03:09,957 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1675779189957 2023-02-07 14:03:09,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-07 14:03:09,968 INFO [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-07 14:03:09,968 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:09,969 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-07 14:03:09,969 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-07 14:03:09,969 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 14:03:09,969 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-07 14:03:09,971 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:09,971 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:09,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:09,971 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:09,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:09,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:09,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:09,971 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:09,971 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:03:09,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-07 14:03:09,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-07 14:03:09,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 14:03:09,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 14:03:09,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-07 14:03:09,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-07 14:03:09,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-07 14:03:09,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-07 14:03:09,972 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-07 14:03:09,972 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-07 14:03:09,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-07 14:03:09,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-07 14:03:09,972 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-07 14:03:09,973 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:09,977 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-07 14:03:09,977 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-07 14:03:09,977 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46503,1675778587200' joining acquired barrier for procedure (foo) in zk 2023-02-07 14:03:09,977 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-07 14:03:09,977 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:09,977 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-07 14:03:09,977 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-07 14:03:09,977 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45179,1675778587172' joining acquired barrier for procedure (foo) in zk 2023-02-07 14:03:09,980 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:09,980 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:09,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:09,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:09,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:09,980 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:09,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:09,980 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-07 14:03:09,980 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:09,981 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-07 14:03:09,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:09,981 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:09,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 14:03:09,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:09,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:09,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:09,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46503,1675778587200' joining acquired barrier for procedure 'foo' on coordinator 2023-02-07 14:03:09,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@525ec3c4[Count = 0] remaining members to acquire global barrier 2023-02-07 14:03:09,982 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-07 14:03:09,982 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:09,983 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 14:03:09,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:09,983 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 14:03:09,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:09,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:09,984 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-07 14:03:09,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:09,984 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:09,984 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-07 14:03:09,984 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-07 14:03:09,984 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:03:09,984 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,45179,1675778587172' in zk 2023-02-07 14:03:09,985 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-07 14:03:09,985 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:09,985 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-07 14:03:09,987 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-07 14:03:09,988 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 14:03:09,988 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:09,988 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. started... 2023-02-07 14:03:09,989 INFO [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 426539f5d38cbea190ebcdbc25104051 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-07 14:03:10,007 INFO [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/.tmp/f1/9fc7a52a3adf4884b66724ff158abaf9 2023-02-07 14:03:10,027 INFO [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/.tmp/f2/6e6ba7aca7524168823d37daf0d3e05c 2023-02-07 14:03:10,031 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/.tmp/f1/9fc7a52a3adf4884b66724ff158abaf9 as hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f1/9fc7a52a3adf4884b66724ff158abaf9 2023-02-07 14:03:10,035 INFO [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f1/9fc7a52a3adf4884b66724ff158abaf9, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 14:03:10,036 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/.tmp/f2/6e6ba7aca7524168823d37daf0d3e05c as hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f2/6e6ba7aca7524168823d37daf0d3e05c 2023-02-07 14:03:10,040 INFO [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f2/6e6ba7aca7524168823d37daf0d3e05c, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 14:03:10,041 INFO [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 426539f5d38cbea190ebcdbc25104051 in 52ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:10,041 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-07 14:03:10,041 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 426539f5d38cbea190ebcdbc25104051: 2023-02-07 14:03:10,041 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.' region-info for snapshot=foo 2023-02-07 14:03:10,041 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:10,042 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f1/9fc7a52a3adf4884b66724ff158abaf9] hfiles 2023-02-07 14:03:10,042 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f1/9fc7a52a3adf4884b66724ff158abaf9 for snapshot=foo 2023-02-07 14:03:10,042 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f2/6e6ba7aca7524168823d37daf0d3e05c] hfiles 2023-02-07 14:03:10,042 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f2/6e6ba7aca7524168823d37daf0d3e05c for snapshot=foo 2023-02-07 14:03:10,047 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. completed. 2023-02-07 14:03:10,047 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:10,047 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-07 14:03:10,047 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-07 14:03:10,047 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,047 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-07 14:03:10,047 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,46503,1675778587200' in zk 2023-02-07 14:03:10,051 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-07 14:03:10,051 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,051 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:10,051 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-07 14:03:10,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:10,052 DEBUG [Listener at localhost/38171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:10,053 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:10,053 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 14:03:10,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-07 14:03:10,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:03:10,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,054 DEBUG [Listener at localhost/38171] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 14:03:10,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 14:03:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,46503,1675778587200': 2023-02-07 14:03:10,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46503,1675778587200' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-07 14:03:10,056 INFO [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-07 14:03:10,056 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:03:10,056 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:03:10,056 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-07 14:03:10,056 INFO [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 14:03:10,057 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 14:03:10,057 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 14:03:10,057 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:10,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-07 14:03:10,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-07 14:03:10,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 14:03:10,057 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 14:03:10,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 14:03:10,057 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-07 14:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:10,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:10,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:10,058 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 14:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 14:03:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 14:03:10,059 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 14:03:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,060 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:10,060 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 14:03:10,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,066 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:10,066 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:10,066 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:10,066 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-07 14:03:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:10,066 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:10,066 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-07 14:03:10,066 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,067 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 14:03:10,067 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:10,067 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:10,067 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,067 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 14:03:10,067 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-07 14:03:10,067 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 14:03:10,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:10,067 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:10,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-07 14:03:10,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:10,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:10,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.hbase-snapshot/.tmp/foo 2023-02-07 14:03:10,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.hbase-snapshot/.tmp/foo to hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.hbase-snapshot/foo 2023-02-07 14:03:10,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-07 14:03:10,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.hbase-snapshot/.tmp/foo 2023-02-07 14:03:10,111 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.hbase-snapshot/.tmp/foo 2023-02-07 14:03:10,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1675778589951Consolidate snapshot: foo at 1675778590067 (+116 ms)Loading Region manifests for foo at 1675778590068 (+1 ms)Writing data manifest for foo at 1675778590071 (+3 ms)Verifying snapshot: foo at 1675778590082 (+11 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1675778590111 (+29 ms) 2023-02-07 14:03:10,113 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-07 14:03:10,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 161 msec 2023-02-07 14:03:10,254 DEBUG [Listener at localhost/38171] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:10,255 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:10,255 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:10,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-07 14:03:10,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 14:03:10,256 INFO [Listener at localhost/38171] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 14:03:10,257 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:10,257 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:10,261 INFO [Listener at localhost/38171] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 14:03:10,267 INFO [Listener at localhost/38171] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 14:03:10,316 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46503] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:10,407 INFO [Listener at localhost/38171] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 14:03:10,410 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:10,411 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:10,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 14:03:10,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,414 INFO [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-07 14:03:10,415 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:10,415 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-07 14:03:10,415 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-07 14:03:10,416 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,416 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,417 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:10,417 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:10,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:10,417 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:10,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:10,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:10,418 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,418 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:03:10,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:03:10,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,419 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,419 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:03:10,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,419 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,420 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-07 14:03:10,420 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:10,420 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-07 14:03:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-07 14:03:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45179,1675778587172' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-07 14:03:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-07 14:03:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,424 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:10,424 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-07 14:03:10,424 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 14:03:10,424 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 14:03:10,424 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:10,424 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. started... 2023-02-07 14:03:10,424 INFO [rs(jenkins-hbase4.apache.org,46503,1675778587200)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 426539f5d38cbea190ebcdbc25104051 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-07 14:03:10,440 INFO [rs(jenkins-hbase4.apache.org,46503,1675778587200)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/.tmp/f1/36bf016575f642b1bd041fa9f851db26 2023-02-07 14:03:10,458 INFO [rs(jenkins-hbase4.apache.org,46503,1675778587200)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/.tmp/f2/43ec2e28010842038a9ef4466e1b51b9 2023-02-07 14:03:10,463 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/.tmp/f1/36bf016575f642b1bd041fa9f851db26 as hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f1/36bf016575f642b1bd041fa9f851db26 2023-02-07 14:03:10,466 INFO [rs(jenkins-hbase4.apache.org,46503,1675778587200)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f1/36bf016575f642b1bd041fa9f851db26, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 14:03:10,467 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/.tmp/f2/43ec2e28010842038a9ef4466e1b51b9 as hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f2/43ec2e28010842038a9ef4466e1b51b9 2023-02-07 14:03:10,471 INFO [rs(jenkins-hbase4.apache.org,46503,1675778587200)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f2/43ec2e28010842038a9ef4466e1b51b9, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 14:03:10,472 INFO [rs(jenkins-hbase4.apache.org,46503,1675778587200)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 426539f5d38cbea190ebcdbc25104051 in 48ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:10,473 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 426539f5d38cbea190ebcdbc25104051: 2023-02-07 14:03:10,473 DEBUG [rs(jenkins-hbase4.apache.org,46503,1675778587200)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:10,473 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 14:03:10,473 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 14:03:10,473 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,473 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-07 14:03:10,473 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46503,1675778587200' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-07 14:03:10,475 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,475 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:10,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:10,476 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,476 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:10,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:10,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:10,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:10,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46503,1675778587200' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-07 14:03:10,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56615d57[Count = 0] remaining members to acquire global barrier 2023-02-07 14:03:10,477 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-07 14:03:10,477 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,478 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,478 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-07 14:03:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-07 14:03:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-07 14:03:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-07 14:03:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,46503,1675778587200' in zk 2023-02-07 14:03:10,479 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,479 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:03:10,479 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,45179,1675778587172' in zk 2023-02-07 14:03:10,480 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,480 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-07 14:03:10,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:10,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:10,480 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:10,480 DEBUG [member: 'jenkins-hbase4.apache.org,46503,1675778587200' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-07 14:03:10,481 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-07 14:03:10,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:10,481 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:10,482 DEBUG [member: 'jenkins-hbase4.apache.org,45179,1675778587172' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-07 14:03:10,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,46503,1675778587200': 2023-02-07 14:03:10,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46503,1675778587200' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-07 14:03:10,485 INFO [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-07 14:03:10,485 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:03:10,485 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:03:10,485 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,485 INFO [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 14:03:10,488 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,488 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:10,488 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,488 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:10,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,488 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:10,488 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:10,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,489 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,490 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:10,491 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,493 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,493 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:10,493 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:10,493 DEBUG [(jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:10,493 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:10,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-07 14:03:10,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 14:03:10,493 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,493 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:10,494 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:10,494 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:10,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:10,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:10,494 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:10,494 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:10,494 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,495 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,495 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,495 DEBUG [Listener at localhost/38171] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-07 14:03:10,495 DEBUG [Listener at localhost/38171] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 14:03:10,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:10,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:10,595 DEBUG [Listener at localhost/38171] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 14:03:10,595 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:10,595 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:10,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 14:03:10,601 INFO [Listener at localhost/38171] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675778589937 type: FLUSH version: 2 ttl: 0 2023-02-07 14:03:10,601 DEBUG [Listener at localhost/38171] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35183/user/jenkins/test-data/1c6d8e59-b180-781d-4b0c-0b635469df4c/foo/27158d2d-8239-4062-84fe-1f23a6b6e71b/data/default/testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,602 INFO [Listener at localhost/38171] snapshot.RestoreSnapshotHelper(239): region to add: 426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:10,602 INFO [Listener at localhost/38171] snapshot.RestoreSnapshotHelper(585): clone region=426539f5d38cbea190ebcdbc25104051 as 426539f5d38cbea190ebcdbc25104051 in snapshot foo 2023-02-07 14:03:10,604 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 426539f5d38cbea190ebcdbc25104051, NAME => 'testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35183/user/jenkins/test-data/1c6d8e59-b180-781d-4b0c-0b635469df4c/foo/27158d2d-8239-4062-84fe-1f23a6b6e71b 2023-02-07 14:03:10,614 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:10,614 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9fc7a52a3adf4884b66724ff158abaf9 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,617 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6e6ba7aca7524168823d37daf0d3e05c from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,619 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 426539f5d38cbea190ebcdbc25104051, disabling compactions & flushes 2023-02-07 14:03:10,619 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:10,619 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:10,619 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. after waiting 0 ms 2023-02-07 14:03:10,619 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:10,619 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:10,619 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 426539f5d38cbea190ebcdbc25104051: Waiting for close lock at 1675778590619Disabling compacts and flushes for region at 1675778590619Disabling writes for close at 1675778590619Writing region close event to WAL at 1675778590619Closed at 1675778590619 2023-02-07 14:03:10,619 INFO [Listener at localhost/38171] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1675778589937 type: FLUSH version: 2 ttl: 0 2023-02-07 14:03:10,619 DEBUG [Listener at localhost/38171] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35183/user/jenkins/test-data/1c6d8e59-b180-781d-4b0c-0b635469df4c/foo/27158d2d-8239-4062-84fe-1f23a6b6e71b 2023-02-07 14:03:10,620 DEBUG [Listener at localhost/38171] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35183/user/jenkins/test-data/1c6d8e59-b180-781d-4b0c-0b635469df4c/foo/27158d2d-8239-4062-84fe-1f23a6b6e71b 2023-02-07 14:03:10,620 DEBUG [Listener at localhost/38171] util.CommonFSUtils(699): |-data/ 2023-02-07 14:03:10,621 DEBUG [Listener at localhost/38171] util.CommonFSUtils(699): |----default/ 2023-02-07 14:03:10,621 DEBUG [Listener at localhost/38171] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-07 14:03:10,622 DEBUG [Listener at localhost/38171] util.CommonFSUtils(699): |----------426539f5d38cbea190ebcdbc25104051/ 2023-02-07 14:03:10,622 DEBUG [Listener at localhost/38171] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:10,622 DEBUG [Listener at localhost/38171] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:10,623 DEBUG [Listener at localhost/38171] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=426539f5d38cbea190ebcdbc25104051-9fc7a52a3adf4884b66724ff158abaf9 2023-02-07 14:03:10,623 DEBUG [Listener at localhost/38171] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:10,623 DEBUG [Listener at localhost/38171] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=426539f5d38cbea190ebcdbc25104051-6e6ba7aca7524168823d37daf0d3e05c 2023-02-07 14:03:10,623 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:10,623 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:10,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-07 14:03:10,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-07 14:03:10,627 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:10,627 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:10,628 INFO [Listener at localhost/38171] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,631 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:10,631 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:10,632 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778590632"}]},"ts":"1675778590632"} 2023-02-07 14:03:10,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 14:03:10,633 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-07 14:03:10,635 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-07 14:03:10,636 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=426539f5d38cbea190ebcdbc25104051, UNASSIGN}] 2023-02-07 14:03:10,637 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=426539f5d38cbea190ebcdbc25104051, UNASSIGN 2023-02-07 14:03:10,638 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=426539f5d38cbea190ebcdbc25104051, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:10,638 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675778590638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778590638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778590638"}]},"ts":"1675778590638"} 2023-02-07 14:03:10,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 426539f5d38cbea190ebcdbc25104051, server=jenkins-hbase4.apache.org,46503,1675778587200}] 2023-02-07 14:03:10,732 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:10,732 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:10,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 14:03:10,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:10,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 426539f5d38cbea190ebcdbc25104051, disabling compactions & flushes 2023-02-07 14:03:10,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:10,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:10,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. after waiting 0 ms 2023-02-07 14:03:10,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:10,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:10,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051. 2023-02-07 14:03:10,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 426539f5d38cbea190ebcdbc25104051: Waiting for close lock at 1675778590792Running coprocessor pre-close hooks at 1675778590792Disabling compacts and flushes for region at 1675778590792Disabling writes for close at 1675778590792Writing region close event to WAL at 1675778590793 (+1 ms)Running coprocessor post-close hooks at 1675778590796 (+3 ms)Closed at 1675778590796 2023-02-07 14:03:10,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:10,798 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=426539f5d38cbea190ebcdbc25104051, regionState=CLOSED 2023-02-07 14:03:10,799 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675778590798"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778590798"}]},"ts":"1675778590798"} 2023-02-07 14:03:10,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-07 14:03:10,801 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 426539f5d38cbea190ebcdbc25104051, server=jenkins-hbase4.apache.org,46503,1675778587200 in 161 msec 2023-02-07 14:03:10,802 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-07 14:03:10,802 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=426539f5d38cbea190ebcdbc25104051, UNASSIGN in 165 msec 2023-02-07 14:03:10,803 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778590803"}]},"ts":"1675778590803"} 2023-02-07 14:03:10,804 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-07 14:03:10,805 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-07 14:03:10,807 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 178 msec 2023-02-07 14:03:10,934 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:10,934 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:10,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 14:03:10,936 INFO [Listener at localhost/38171] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-07 14:03:10,936 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:10,936 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:10,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,940 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,940 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:10,940 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:10,941 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 14:03:10,944 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:10,946 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f1, FileablePath, hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f2, FileablePath, hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/recovered.edits] 2023-02-07 14:03:10,949 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f1/36bf016575f642b1bd041fa9f851db26 to hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/archive/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f1/36bf016575f642b1bd041fa9f851db26 2023-02-07 14:03:10,950 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f1/9fc7a52a3adf4884b66724ff158abaf9 to hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/archive/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f1/9fc7a52a3adf4884b66724ff158abaf9 2023-02-07 14:03:10,953 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f2/43ec2e28010842038a9ef4466e1b51b9 to hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/archive/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f2/43ec2e28010842038a9ef4466e1b51b9 2023-02-07 14:03:10,954 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f2/6e6ba7aca7524168823d37daf0d3e05c to hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/archive/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/f2/6e6ba7aca7524168823d37daf0d3e05c 2023-02-07 14:03:10,956 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/recovered.edits/12.seqid to hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/archive/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051/recovered.edits/12.seqid 2023-02-07 14:03:10,956 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/.tmp/data/default/testInitTableSnapshotMapperJobConfig/426539f5d38cbea190ebcdbc25104051 2023-02-07 14:03:10,957 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-07 14:03:10,959 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,960 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-07 14:03:10,962 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-07 14:03:10,963 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,963 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-07 14:03:10,963 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778590963"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:10,964 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-07 14:03:10,964 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 426539f5d38cbea190ebcdbc25104051, NAME => 'testInitTableSnapshotMapperJobConfig,,1675778589148.426539f5d38cbea190ebcdbc25104051.', STARTKEY => '', ENDKEY => ''}] 2023-02-07 14:03:10,964 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-07 14:03:10,964 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675778590964"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:10,967 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-07 14:03:10,971 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-07 14:03:10,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 34 msec 2023-02-07 14:03:11,042 INFO [Listener at localhost/38171] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:11,042 INFO [Listener at localhost/38171] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:11,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37375] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 14:03:11,043 INFO [Listener at localhost/38171] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-07 14:03:11,043 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 14:03:11,044 INFO [Listener at localhost/38171] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 14:03:11,044 DEBUG [Listener at localhost/38171] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1438893e to 127.0.0.1:57122 2023-02-07 14:03:11,044 DEBUG [Listener at localhost/38171] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:11,044 DEBUG [Listener at localhost/38171] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 14:03:11,044 DEBUG [Listener at localhost/38171] util.JVMClusterUtil(257): Found active master hash=378949674, stopped=false 2023-02-07 14:03:11,044 INFO [Listener at localhost/38171] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37375,1675778587113 2023-02-07 14:03:11,046 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:11,046 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:11,046 INFO [Listener at localhost/38171] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 14:03:11,046 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:11,046 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:11,048 DEBUG [Listener at localhost/38171] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x031fc8db to 127.0.0.1:57122 2023-02-07 14:03:11,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:11,049 DEBUG [Listener at localhost/38171] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:11,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:11,049 INFO [Listener at localhost/38171] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45179,1675778587172' ***** 2023-02-07 14:03:11,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:11,049 INFO [Listener at localhost/38171] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:03:11,049 INFO [Listener at localhost/38171] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46503,1675778587200' ***** 2023-02-07 14:03:11,049 INFO [Listener at localhost/38171] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:03:11,049 INFO [RS:0;jenkins-hbase4:45179] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:03:11,049 INFO [RS:1;jenkins-hbase4:46503] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:03:11,049 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:03:11,049 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:03:11,049 INFO [RS:0;jenkins-hbase4:45179] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:03:11,049 INFO [RS:1;jenkins-hbase4:46503] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:03:11,051 INFO [RS:0;jenkins-hbase4:45179] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:03:11,051 INFO [RS:1;jenkins-hbase4:46503] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:03:11,051 INFO [RS:0;jenkins-hbase4:45179] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:11,051 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(3304): Received CLOSE for e12e853763830a7cca85efa8cedec3b0 2023-02-07 14:03:11,051 DEBUG [RS:0;jenkins-hbase4:45179] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32d4fa02 to 127.0.0.1:57122 2023-02-07 14:03:11,051 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:11,051 DEBUG [RS:0;jenkins-hbase4:45179] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:11,051 DEBUG [RS:1;jenkins-hbase4:46503] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17c51dd0 to 127.0.0.1:57122 2023-02-07 14:03:11,051 INFO [RS:0;jenkins-hbase4:45179] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45179,1675778587172; all regions closed. 2023-02-07 14:03:11,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e12e853763830a7cca85efa8cedec3b0, disabling compactions & flushes 2023-02-07 14:03:11,052 DEBUG [RS:1;jenkins-hbase4:46503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:11,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. 2023-02-07 14:03:11,052 INFO [RS:1;jenkins-hbase4:46503] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:03:11,052 INFO [RS:1;jenkins-hbase4:46503] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:03:11,052 INFO [RS:1;jenkins-hbase4:46503] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:03:11,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. 2023-02-07 14:03:11,052 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 14:03:11,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. after waiting 0 ms 2023-02-07 14:03:11,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. 2023-02-07 14:03:11,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e12e853763830a7cca85efa8cedec3b0 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 14:03:11,052 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-07 14:03:11,053 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, e12e853763830a7cca85efa8cedec3b0=hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0.} 2023-02-07 14:03:11,053 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:03:11,053 DEBUG [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1505): Waiting on 1588230740, e12e853763830a7cca85efa8cedec3b0 2023-02-07 14:03:11,053 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:03:11,053 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:03:11,053 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:03:11,053 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:03:11,053 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-07 14:03:11,059 DEBUG [RS:0;jenkins-hbase4:45179] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/oldWALs 2023-02-07 14:03:11,059 INFO [RS:0;jenkins-hbase4:45179] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45179%2C1675778587172:(num 1675778588913) 2023-02-07 14:03:11,059 DEBUG [RS:0;jenkins-hbase4:45179] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:11,059 INFO [RS:0;jenkins-hbase4:45179] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:11,059 INFO [RS:0;jenkins-hbase4:45179] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 14:03:11,059 INFO [RS:0;jenkins-hbase4:45179] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:03:11,059 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:11,059 INFO [RS:0;jenkins-hbase4:45179] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:03:11,059 INFO [RS:0;jenkins-hbase4:45179] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:03:11,060 INFO [RS:0;jenkins-hbase4:45179] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45179 2023-02-07 14:03:11,061 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:11,061 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:11,062 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45179,1675778587172 2023-02-07 14:03:11,062 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:11,062 ERROR [Listener at localhost/38171-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b224abd rejected from java.util.concurrent.ThreadPoolExecutor@6f1dc301[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:11,062 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:11,062 ERROR [Listener at localhost/38171-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6271c394 rejected from java.util.concurrent.ThreadPoolExecutor@6f1dc301[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:11,062 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45179,1675778587172] 2023-02-07 14:03:11,062 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45179,1675778587172; numProcessing=1 2023-02-07 14:03:11,064 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45179,1675778587172 already deleted, retry=false 2023-02-07 14:03:11,065 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45179,1675778587172 expired; onlineServers=1 2023-02-07 14:03:11,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/namespace/e12e853763830a7cca85efa8cedec3b0/.tmp/info/5ca97548bb7d4d679525d109b12dba26 2023-02-07 14:03:11,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/.tmp/info/9739787d78cd4e6781777538ac98fb54 2023-02-07 14:03:11,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/namespace/e12e853763830a7cca85efa8cedec3b0/.tmp/info/5ca97548bb7d4d679525d109b12dba26 as hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/namespace/e12e853763830a7cca85efa8cedec3b0/info/5ca97548bb7d4d679525d109b12dba26 2023-02-07 14:03:11,083 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:11,085 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9739787d78cd4e6781777538ac98fb54 2023-02-07 14:03:11,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/namespace/e12e853763830a7cca85efa8cedec3b0/info/5ca97548bb7d4d679525d109b12dba26, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 14:03:11,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e12e853763830a7cca85efa8cedec3b0 in 37ms, sequenceid=6, compaction requested=false 2023-02-07 14:03:11,090 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:11,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/namespace/e12e853763830a7cca85efa8cedec3b0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 14:03:11,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. 2023-02-07 14:03:11,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e12e853763830a7cca85efa8cedec3b0: Waiting for close lock at 1675778591051Running coprocessor pre-close hooks at 1675778591051Disabling compacts and flushes for region at 1675778591051Disabling writes for close at 1675778591052 (+1 ms)Obtaining lock to block concurrent updates at 1675778591052Preparing flush snapshotting stores in e12e853763830a7cca85efa8cedec3b0 at 1675778591052Finished memstore snapshotting hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675778591053 (+1 ms)Flushing stores of hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. at 1675778591055 (+2 ms)Flushing e12e853763830a7cca85efa8cedec3b0/info: creating writer at 1675778591055Flushing e12e853763830a7cca85efa8cedec3b0/info: appending metadata at 1675778591058 (+3 ms)Flushing e12e853763830a7cca85efa8cedec3b0/info: closing flushed file at 1675778591058Flushing e12e853763830a7cca85efa8cedec3b0/info: reopening flushed file at 1675778591082 (+24 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e12e853763830a7cca85efa8cedec3b0 in 37ms, sequenceid=6, compaction requested=false at 1675778591089 (+7 ms)Writing region close event to WAL at 1675778591089Running coprocessor post-close hooks at 1675778591094 (+5 ms)Closed at 1675778591094 2023-02-07 14:03:11,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675778588583.e12e853763830a7cca85efa8cedec3b0. 2023-02-07 14:03:11,096 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/.tmp/rep_barrier/21b76f12b14b43048929ab92634cc73b 2023-02-07 14:03:11,099 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21b76f12b14b43048929ab92634cc73b 2023-02-07 14:03:11,106 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/.tmp/table/d5b2c5d90cde4e53a050e3a67b2574dd 2023-02-07 14:03:11,110 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5b2c5d90cde4e53a050e3a67b2574dd 2023-02-07 14:03:11,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/.tmp/info/9739787d78cd4e6781777538ac98fb54 as hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/info/9739787d78cd4e6781777538ac98fb54 2023-02-07 14:03:11,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9739787d78cd4e6781777538ac98fb54 2023-02-07 14:03:11,114 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/info/9739787d78cd4e6781777538ac98fb54, entries=12, sequenceid=21, filesize=6.3 K 2023-02-07 14:03:11,115 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/.tmp/rep_barrier/21b76f12b14b43048929ab92634cc73b as hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/rep_barrier/21b76f12b14b43048929ab92634cc73b 2023-02-07 14:03:11,119 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21b76f12b14b43048929ab92634cc73b 2023-02-07 14:03:11,119 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/rep_barrier/21b76f12b14b43048929ab92634cc73b, entries=1, sequenceid=21, filesize=5.0 K 2023-02-07 14:03:11,120 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/.tmp/table/d5b2c5d90cde4e53a050e3a67b2574dd as hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/table/d5b2c5d90cde4e53a050e3a67b2574dd 2023-02-07 14:03:11,124 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5b2c5d90cde4e53a050e3a67b2574dd 2023-02-07 14:03:11,124 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/table/d5b2c5d90cde4e53a050e3a67b2574dd, entries=4, sequenceid=21, filesize=5.1 K 2023-02-07 14:03:11,125 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 72ms, sequenceid=21, compaction requested=false 2023-02-07 14:03:11,129 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-07 14:03:11,130 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 14:03:11,130 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:11,130 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778591053Running coprocessor pre-close hooks at 1675778591053Disabling compacts and flushes for region at 1675778591053Disabling writes for close at 1675778591053Obtaining lock to block concurrent updates at 1675778591053Preparing flush snapshotting stores in 1588230740 at 1675778591053Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1675778591054 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675778591056 (+2 ms)Flushing 1588230740/info: creating writer at 1675778591056Flushing 1588230740/info: appending metadata at 1675778591059 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675778591059Flushing 1588230740/rep_barrier: creating writer at 1675778591085 (+26 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675778591088 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675778591088Flushing 1588230740/table: creating writer at 1675778591100 (+12 ms)Flushing 1588230740/table: appending metadata at 1675778591101 (+1 ms)Flushing 1588230740/table: closing flushed file at 1675778591101Flushing 1588230740/info: reopening flushed file at 1675778591111 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675778591116 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675778591120 (+4 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 72ms, sequenceid=21, compaction requested=false at 1675778591125 (+5 ms)Writing region close event to WAL at 1675778591126 (+1 ms)Running coprocessor post-close hooks at 1675778591130 (+4 ms)Closed at 1675778591130 2023-02-07 14:03:11,130 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:11,246 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:11,246 INFO [RS:0;jenkins-hbase4:45179] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45179,1675778587172; zookeeper connection closed. 2023-02-07 14:03:11,246 ERROR [Listener at localhost/38171-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1afbd760 rejected from java.util.concurrent.ThreadPoolExecutor@6f1dc301[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:11,248 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@78180df6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@78180df6 2023-02-07 14:03:11,248 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:45179-0x1002f17e39e0001, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:11,248 ERROR [Listener at localhost/38171-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2631a878 rejected from java.util.concurrent.ThreadPoolExecutor@6f1dc301[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:11,253 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46503,1675778587200; all regions closed. 2023-02-07 14:03:11,259 DEBUG [RS:1;jenkins-hbase4:46503] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/oldWALs 2023-02-07 14:03:11,259 INFO [RS:1;jenkins-hbase4:46503] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46503%2C1675778587200.meta:.meta(num 1675778588530) 2023-02-07 14:03:11,264 DEBUG [RS:1;jenkins-hbase4:46503] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/oldWALs 2023-02-07 14:03:11,264 INFO [RS:1;jenkins-hbase4:46503] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46503%2C1675778587200:(num 1675778588914) 2023-02-07 14:03:11,264 DEBUG [RS:1;jenkins-hbase4:46503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:11,264 INFO [RS:1;jenkins-hbase4:46503] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:11,264 INFO [RS:1;jenkins-hbase4:46503] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 14:03:11,265 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:11,265 INFO [RS:1;jenkins-hbase4:46503] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46503 2023-02-07 14:03:11,267 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46503,1675778587200 2023-02-07 14:03:11,267 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:11,267 ERROR [Listener at localhost/38171-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a17099 rejected from java.util.concurrent.ThreadPoolExecutor@9ee4d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:11,268 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46503,1675778587200] 2023-02-07 14:03:11,268 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46503,1675778587200; numProcessing=2 2023-02-07 14:03:11,269 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46503,1675778587200 already deleted, retry=false 2023-02-07 14:03:11,269 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46503,1675778587200 expired; onlineServers=0 2023-02-07 14:03:11,269 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37375,1675778587113' ***** 2023-02-07 14:03:11,269 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 14:03:11,270 DEBUG [M:0;jenkins-hbase4:37375] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12a9d620, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:11,270 INFO [M:0;jenkins-hbase4:37375] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37375,1675778587113 2023-02-07 14:03:11,270 INFO [M:0;jenkins-hbase4:37375] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37375,1675778587113; all regions closed. 2023-02-07 14:03:11,270 DEBUG [M:0;jenkins-hbase4:37375] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:11,270 DEBUG [M:0;jenkins-hbase4:37375] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 14:03:11,270 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 14:03:11,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778587775] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778587775,5,FailOnTimeoutGroup] 2023-02-07 14:03:11,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778587775] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778587775,5,FailOnTimeoutGroup] 2023-02-07 14:03:11,270 DEBUG [M:0;jenkins-hbase4:37375] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 14:03:11,272 INFO [M:0;jenkins-hbase4:37375] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 14:03:11,272 INFO [M:0;jenkins-hbase4:37375] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 14:03:11,272 INFO [M:0;jenkins-hbase4:37375] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 14:03:11,272 DEBUG [M:0;jenkins-hbase4:37375] master.HMaster(1502): Stopping service threads 2023-02-07 14:03:11,272 INFO [M:0;jenkins-hbase4:37375] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 14:03:11,272 ERROR [M:0;jenkins-hbase4:37375] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 14:03:11,273 INFO [M:0;jenkins-hbase4:37375] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 14:03:11,273 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 14:03:11,274 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:11,274 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:11,274 DEBUG [M:0;jenkins-hbase4:37375] zookeeper.ZKUtil(398): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 14:03:11,274 WARN [M:0;jenkins-hbase4:37375] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 14:03:11,274 INFO [M:0;jenkins-hbase4:37375] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 14:03:11,275 INFO [M:0;jenkins-hbase4:37375] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 14:03:11,275 DEBUG [M:0;jenkins-hbase4:37375] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:03:11,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:11,275 INFO [M:0;jenkins-hbase4:37375] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:11,275 DEBUG [M:0;jenkins-hbase4:37375] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:11,275 DEBUG [M:0;jenkins-hbase4:37375] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:03:11,275 DEBUG [M:0;jenkins-hbase4:37375] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:11,275 INFO [M:0;jenkins-hbase4:37375] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.91 KB heapSize=66.85 KB 2023-02-07 14:03:11,286 INFO [M:0;jenkins-hbase4:37375] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.91 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/21f04a24b1164a2f81a6d235725d8151 2023-02-07 14:03:11,290 DEBUG [M:0;jenkins-hbase4:37375] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/21f04a24b1164a2f81a6d235725d8151 as hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/21f04a24b1164a2f81a6d235725d8151 2023-02-07 14:03:11,294 INFO [M:0;jenkins-hbase4:37375] regionserver.HStore(1080): Added hdfs://localhost:35183/user/jenkins/test-data/e43069d9-fec4-2467-58ea-304cf9dc9978/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/21f04a24b1164a2f81a6d235725d8151, entries=17, sequenceid=132, filesize=8.7 K 2023-02-07 14:03:11,294 INFO [M:0;jenkins-hbase4:37375] regionserver.HRegion(2947): Finished flush of dataSize ~55.91 KB/57248, heapSize ~66.84 KB/68440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false 2023-02-07 14:03:11,295 INFO [M:0;jenkins-hbase4:37375] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:11,295 DEBUG [M:0;jenkins-hbase4:37375] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778591275Disabling compacts and flushes for region at 1675778591275Disabling writes for close at 1675778591275Obtaining lock to block concurrent updates at 1675778591275Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675778591275Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57248, getHeapSize=68440, getOffHeapSize=0, getCellsCount=145 at 1675778591276 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675778591277 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675778591277Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675778591279 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675778591280 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675778591291 (+11 ms)Finished flush of dataSize ~55.91 KB/57248, heapSize ~66.84 KB/68440, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false at 1675778591295 (+4 ms)Writing region close event to WAL at 1675778591295Closed at 1675778591295 2023-02-07 14:03:11,298 INFO [M:0;jenkins-hbase4:37375] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 14:03:11,298 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:11,299 INFO [M:0;jenkins-hbase4:37375] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37375 2023-02-07 14:03:11,300 DEBUG [M:0;jenkins-hbase4:37375] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37375,1675778587113 already deleted, retry=false 2023-02-07 14:03:11,649 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:11,649 INFO [M:0;jenkins-hbase4:37375] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37375,1675778587113; zookeeper connection closed. 2023-02-07 14:03:11,649 ERROR [Listener at localhost/38171-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e1ebda0 rejected from java.util.concurrent.ThreadPoolExecutor@2a213cbb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:11,650 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): master:37375-0x1002f17e39e0000, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:11,650 ERROR [Listener at localhost/38171-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@52ed2bb rejected from java.util.concurrent.ThreadPoolExecutor@2a213cbb[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 52] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:11,749 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:11,749 INFO [RS:1;jenkins-hbase4:46503] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46503,1675778587200; zookeeper connection closed. 2023-02-07 14:03:11,749 ERROR [Listener at localhost/38171-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7bb9de13 rejected from java.util.concurrent.ThreadPoolExecutor@9ee4d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:11,749 DEBUG [Listener at localhost/38171-EventThread] zookeeper.ZKWatcher(600): regionserver:46503-0x1002f17e39e0002, quorum=127.0.0.1:57122, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:11,749 ERROR [Listener at localhost/38171-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3dca65e rejected from java.util.concurrent.ThreadPoolExecutor@9ee4d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:11,749 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@a696cab] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@a696cab 2023-02-07 14:03:11,749 INFO [Listener at localhost/38171] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 14:03:11,750 WARN [Listener at localhost/38171] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:03:11,754 INFO [Listener at localhost/38171] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:11,859 WARN [BP-1650783783-172.31.14.131-1675778586553 heartbeating to localhost/127.0.0.1:35183] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 14:03:11,859 WARN [BP-1650783783-172.31.14.131-1675778586553 heartbeating to localhost/127.0.0.1:35183] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1650783783-172.31.14.131-1675778586553 (Datanode Uuid d3381372-d43d-4605-aa52-0ee78b5d7b06) service to localhost/127.0.0.1:35183 2023-02-07 14:03:11,860 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/cluster_148e837b-4781-2289-0a4e-0066806282c7/dfs/data/data3/current/BP-1650783783-172.31.14.131-1675778586553] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:11,860 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/cluster_148e837b-4781-2289-0a4e-0066806282c7/dfs/data/data4/current/BP-1650783783-172.31.14.131-1675778586553] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:11,861 WARN [Listener at localhost/38171] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:03:11,864 INFO [Listener at localhost/38171] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:11,903 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 14:03:11,970 WARN [BP-1650783783-172.31.14.131-1675778586553 heartbeating to localhost/127.0.0.1:35183] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 14:03:11,970 WARN [BP-1650783783-172.31.14.131-1675778586553 heartbeating to localhost/127.0.0.1:35183] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1650783783-172.31.14.131-1675778586553 (Datanode Uuid 8792b3f1-ebfe-48f9-93f9-c12acf0f1ea5) service to localhost/127.0.0.1:35183 2023-02-07 14:03:11,971 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/cluster_148e837b-4781-2289-0a4e-0066806282c7/dfs/data/data1/current/BP-1650783783-172.31.14.131-1675778586553] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:11,971 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/cluster_148e837b-4781-2289-0a4e-0066806282c7/dfs/data/data2/current/BP-1650783783-172.31.14.131-1675778586553] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:11,982 INFO [Listener at localhost/38171] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:12,097 INFO [Listener at localhost/38171] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 14:03:12,118 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 14:03:12,130 INFO [Listener at localhost/38171] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=178 (was 154) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:35183 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:35183 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:35183 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37375,1675778587113)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:35183 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35183 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:35183 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Listener at localhost/38171 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:35183 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=568 (was 538) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=260 (was 266), ProcessCount=166 (was 166), AvailableMemoryMB=5498 (was 5543) 2023-02-07 14:03:12,140 INFO [Listener at localhost/38171] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=178, OpenFileDescriptor=568, MaxFileDescriptor=60000, SystemLoadAverage=260, ProcessCount=166, AvailableMemoryMB=5498 2023-02-07 14:03:12,151 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/hadoop.log.dir so I do NOT create it in target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3 2023-02-07 14:03:12,151 WARN [Listener at localhost/38171] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 14:03:12,151 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/hadoop.tmp.dir so I do NOT create it in target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3 2023-02-07 14:03:12,151 WARN [Listener at localhost/38171] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3ed5c12f-8481-b2e3-ea29-83915c68a240/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 14:03:12,151 DEBUG [Listener at localhost/38171] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3 2023-02-07 14:03:12,151 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 14:03:12,151 INFO [Listener at localhost/38171] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/cluster_0b7b8ea2-5371-3e0e-a08a-41ba9695617d, deleteOnExit=true 2023-02-07 14:03:12,151 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 14:03:12,151 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/test.cache.data in system properties and HBase conf 2023-02-07 14:03:12,151 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 14:03:12,152 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/hadoop.log.dir in system properties and HBase conf 2023-02-07 14:03:12,152 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 14:03:12,152 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 14:03:12,152 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 14:03:12,152 DEBUG [Listener at localhost/38171] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 14:03:12,152 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:03:12,152 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:03:12,152 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 14:03:12,152 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:03:12,153 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 14:03:12,153 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 14:03:12,153 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:03:12,153 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:03:12,153 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 14:03:12,153 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/nfs.dump.dir in system properties and HBase conf 2023-02-07 14:03:12,153 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/java.io.tmpdir in system properties and HBase conf 2023-02-07 14:03:12,153 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:03:12,153 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 14:03:12,153 INFO [Listener at localhost/38171] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 14:03:12,157 WARN [Listener at localhost/38171] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:03:12,157 WARN [Listener at localhost/38171] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:03:12,195 WARN [Listener at localhost/38171] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:12,197 INFO [Listener at localhost/38171] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:12,203 INFO [Listener at localhost/38171] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/java.io.tmpdir/Jetty_localhost_44749_hdfs____.aryuvu/webapp 2023-02-07 14:03:12,297 INFO [Listener at localhost/38171] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44749 2023-02-07 14:03:12,302 WARN [Listener at localhost/38171] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:03:12,302 WARN [Listener at localhost/38171] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:03:12,350 WARN [Listener at localhost/38577] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:12,362 WARN [Listener at localhost/38577] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:03:12,364 WARN [Listener at localhost/38577] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:12,366 INFO [Listener at localhost/38577] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:12,373 INFO [Listener at localhost/38577] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/java.io.tmpdir/Jetty_localhost_43107_datanode____.l831q8/webapp 2023-02-07 14:03:12,467 INFO [Listener at localhost/38577] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43107 2023-02-07 14:03:12,477 WARN [Listener at localhost/43509] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:12,505 WARN [Listener at localhost/43509] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:03:12,507 WARN [Listener at localhost/43509] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:12,509 INFO [Listener at localhost/43509] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:12,512 INFO [Listener at localhost/43509] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/java.io.tmpdir/Jetty_localhost_44349_datanode____.mya84h/webapp 2023-02-07 14:03:12,584 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x585956c95018807b: Processing first storage report for DS-25dec9ad-9539-43a5-9353-9adb0756f08f from datanode 63df5d2e-ebb0-4d5a-80e4-fc20171a3e97 2023-02-07 14:03:12,584 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x585956c95018807b: from storage DS-25dec9ad-9539-43a5-9353-9adb0756f08f node DatanodeRegistration(127.0.0.1:44797, datanodeUuid=63df5d2e-ebb0-4d5a-80e4-fc20171a3e97, infoPort=39977, infoSecurePort=0, ipcPort=43509, storageInfo=lv=-57;cid=testClusterID;nsid=914016344;c=1675778592160), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:12,584 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x585956c95018807b: Processing first storage report for DS-858ead32-384a-47ab-9892-d296627e2ad3 from datanode 63df5d2e-ebb0-4d5a-80e4-fc20171a3e97 2023-02-07 14:03:12,584 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x585956c95018807b: from storage DS-858ead32-384a-47ab-9892-d296627e2ad3 node DatanodeRegistration(127.0.0.1:44797, datanodeUuid=63df5d2e-ebb0-4d5a-80e4-fc20171a3e97, infoPort=39977, infoSecurePort=0, ipcPort=43509, storageInfo=lv=-57;cid=testClusterID;nsid=914016344;c=1675778592160), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:12,613 INFO [Listener at localhost/43509] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44349 2023-02-07 14:03:12,624 WARN [Listener at localhost/45865] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:12,721 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x22b90af75186333e: Processing first storage report for DS-2d1e5a21-4bf3-4084-b855-a32b4ea8f4b3 from datanode 54aeb1ed-34b4-48e6-a328-121735ad143e 2023-02-07 14:03:12,721 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x22b90af75186333e: from storage DS-2d1e5a21-4bf3-4084-b855-a32b4ea8f4b3 node DatanodeRegistration(127.0.0.1:41435, datanodeUuid=54aeb1ed-34b4-48e6-a328-121735ad143e, infoPort=41517, infoSecurePort=0, ipcPort=45865, storageInfo=lv=-57;cid=testClusterID;nsid=914016344;c=1675778592160), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:12,721 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x22b90af75186333e: Processing first storage report for DS-3958b51e-6640-40bc-9746-8f188142101f from datanode 54aeb1ed-34b4-48e6-a328-121735ad143e 2023-02-07 14:03:12,721 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x22b90af75186333e: from storage DS-3958b51e-6640-40bc-9746-8f188142101f node DatanodeRegistration(127.0.0.1:41435, datanodeUuid=54aeb1ed-34b4-48e6-a328-121735ad143e, infoPort=41517, infoSecurePort=0, ipcPort=45865, storageInfo=lv=-57;cid=testClusterID;nsid=914016344;c=1675778592160), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:12,735 DEBUG [Listener at localhost/45865] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3 2023-02-07 14:03:12,737 INFO [Listener at localhost/45865] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/cluster_0b7b8ea2-5371-3e0e-a08a-41ba9695617d/zookeeper_0, clientPort=61542, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/cluster_0b7b8ea2-5371-3e0e-a08a-41ba9695617d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/cluster_0b7b8ea2-5371-3e0e-a08a-41ba9695617d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 14:03:12,738 INFO [Listener at localhost/45865] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61542 2023-02-07 14:03:12,738 INFO [Listener at localhost/45865] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:12,739 INFO [Listener at localhost/45865] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:12,751 INFO [Listener at localhost/45865] util.FSUtils(479): Created version file at hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97 with version=8 2023-02-07 14:03:12,752 INFO [Listener at localhost/45865] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:12,752 INFO [Listener at localhost/45865] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:12,753 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/hbase-staging 2023-02-07 14:03:12,755 INFO [Listener at localhost/45865] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:12,755 INFO [Listener at localhost/45865] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:12,755 INFO [Listener at localhost/45865] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:12,755 INFO [Listener at localhost/45865] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:12,756 INFO [Listener at localhost/45865] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:12,756 INFO [Listener at localhost/45865] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:12,756 INFO [Listener at localhost/45865] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:12,756 INFO [Listener at localhost/45865] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37885 2023-02-07 14:03:12,757 INFO [Listener at localhost/45865] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:12,757 INFO [Listener at localhost/45865] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:12,758 INFO [Listener at localhost/45865] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37885 connecting to ZooKeeper ensemble=127.0.0.1:61542 2023-02-07 14:03:12,772 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:378850x0, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:12,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37885-0x1002f17f9a50000 connected 2023-02-07 14:03:12,788 DEBUG [Listener at localhost/45865] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:12,788 DEBUG [Listener at localhost/45865] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:12,789 DEBUG [Listener at localhost/45865] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:12,791 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37885 2023-02-07 14:03:12,791 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37885 2023-02-07 14:03:12,792 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37885 2023-02-07 14:03:12,793 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37885 2023-02-07 14:03:12,793 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37885 2023-02-07 14:03:12,793 INFO [Listener at localhost/45865] master.HMaster(439): hbase.rootdir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97, hbase.cluster.distributed=false 2023-02-07 14:03:12,805 INFO [Listener at localhost/45865] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:12,805 INFO [Listener at localhost/45865] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:12,805 INFO [Listener at localhost/45865] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:12,805 INFO [Listener at localhost/45865] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:12,806 INFO [Listener at localhost/45865] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:12,806 INFO [Listener at localhost/45865] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:12,806 INFO [Listener at localhost/45865] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:12,808 INFO [Listener at localhost/45865] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44239 2023-02-07 14:03:12,808 INFO [Listener at localhost/45865] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:03:12,810 DEBUG [Listener at localhost/45865] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:12,811 INFO [Listener at localhost/45865] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:12,811 INFO [Listener at localhost/45865] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:12,812 INFO [Listener at localhost/45865] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44239 connecting to ZooKeeper ensemble=127.0.0.1:61542 2023-02-07 14:03:12,817 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:442390x0, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:12,818 DEBUG [Listener at localhost/45865] zookeeper.ZKUtil(164): regionserver:442390x0, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:12,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44239-0x1002f17f9a50001 connected 2023-02-07 14:03:12,855 DEBUG [Listener at localhost/45865] zookeeper.ZKUtil(164): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:12,857 DEBUG [Listener at localhost/45865] zookeeper.ZKUtil(164): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:12,860 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44239 2023-02-07 14:03:12,860 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44239 2023-02-07 14:03:12,861 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44239 2023-02-07 14:03:12,863 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44239 2023-02-07 14:03:12,864 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44239 2023-02-07 14:03:12,876 INFO [Listener at localhost/45865] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:12,876 INFO [Listener at localhost/45865] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:12,876 INFO [Listener at localhost/45865] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:12,876 INFO [Listener at localhost/45865] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:12,876 INFO [Listener at localhost/45865] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:12,876 INFO [Listener at localhost/45865] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:12,876 INFO [Listener at localhost/45865] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:12,877 INFO [Listener at localhost/45865] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45365 2023-02-07 14:03:12,877 INFO [Listener at localhost/45865] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:03:12,878 DEBUG [Listener at localhost/45865] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:12,879 INFO [Listener at localhost/45865] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:12,879 INFO [Listener at localhost/45865] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:12,880 INFO [Listener at localhost/45865] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45365 connecting to ZooKeeper ensemble=127.0.0.1:61542 2023-02-07 14:03:12,884 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:453650x0, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:12,885 DEBUG [Listener at localhost/45865] zookeeper.ZKUtil(164): regionserver:453650x0, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:12,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45365-0x1002f17f9a50002 connected 2023-02-07 14:03:12,885 DEBUG [Listener at localhost/45865] zookeeper.ZKUtil(164): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:12,886 DEBUG [Listener at localhost/45865] zookeeper.ZKUtil(164): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:12,886 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45365 2023-02-07 14:03:12,888 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45365 2023-02-07 14:03:12,888 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45365 2023-02-07 14:03:12,889 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45365 2023-02-07 14:03:12,890 DEBUG [Listener at localhost/45865] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45365 2023-02-07 14:03:12,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37885,1675778592755 2023-02-07 14:03:12,894 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:03:12,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37885,1675778592755 2023-02-07 14:03:12,895 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:12,895 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:12,895 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:12,896 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:12,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:03:12,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37885,1675778592755 from backup master directory 2023-02-07 14:03:12,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:03:12,899 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37885,1675778592755 2023-02-07 14:03:12,899 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:03:12,899 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:12,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,37885,1675778592755 2023-02-07 14:03:12,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/hbase.id with ID: 5b354903-2043-4ebb-96b7-1c549559bd51 2023-02-07 14:03:12,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:12,925 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:12,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3e53f994 to 127.0.0.1:61542 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:12,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d111ab8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:12,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:12,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 14:03:12,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:12,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/MasterData/data/master/store-tmp 2023-02-07 14:03:12,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:12,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:03:12,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:12,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:12,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:03:12,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:12,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:12,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778592946Disabling compacts and flushes for region at 1675778592946Disabling writes for close at 1675778592946Writing region close event to WAL at 1675778592946Closed at 1675778592946 2023-02-07 14:03:12,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/MasterData/WALs/jenkins-hbase4.apache.org,37885,1675778592755 2023-02-07 14:03:12,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37885%2C1675778592755, suffix=, logDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/MasterData/WALs/jenkins-hbase4.apache.org,37885,1675778592755, archiveDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/MasterData/oldWALs, maxLogs=10 2023-02-07 14:03:12,963 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41435,DS-2d1e5a21-4bf3-4084-b855-a32b4ea8f4b3,DISK] 2023-02-07 14:03:12,964 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44797,DS-25dec9ad-9539-43a5-9353-9adb0756f08f,DISK] 2023-02-07 14:03:12,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/MasterData/WALs/jenkins-hbase4.apache.org,37885,1675778592755/jenkins-hbase4.apache.org%2C37885%2C1675778592755.1675778592949 2023-02-07 14:03:12,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41435,DS-2d1e5a21-4bf3-4084-b855-a32b4ea8f4b3,DISK], DatanodeInfoWithStorage[127.0.0.1:44797,DS-25dec9ad-9539-43a5-9353-9adb0756f08f,DISK]] 2023-02-07 14:03:12,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:12,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:12,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:12,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:12,972 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:12,973 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 14:03:12,973 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 14:03:12,974 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:12,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:12,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:12,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:12,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:12,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68574413, jitterRate=0.02183838188648224}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:03:12,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675778592970Initializing all the Stores at 1675778592971 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778592971Cleaning up temporary data from old regions at 1675778592975 (+4 ms)Cleaning up detritus from prior splits at 1675778592976 (+1 ms)Region opened successfully at 1675778592980 (+4 ms) 2023-02-07 14:03:12,989 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 14:03:12,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 14:03:12,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 14:03:12,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 14:03:12,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 14:03:12,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 14:03:12,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 14:03:12,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 14:03:12,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 14:03:13,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 14:03:13,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 14:03:13,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 14:03:13,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 14:03:13,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 14:03:13,012 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:13,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 14:03:13,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 14:03:13,013 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 14:03:13,015 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:13,015 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:13,015 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:13,015 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:13,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,37885,1675778592755, sessionid=0x1002f17f9a50000, setting cluster-up flag (Was=false) 2023-02-07 14:03:13,022 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:13,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 14:03:13,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37885,1675778592755 2023-02-07 14:03:13,030 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:13,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 14:03:13,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37885,1675778592755 2023-02-07 14:03:13,036 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.hbase-snapshot/.tmp 2023-02-07 14:03:13,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:13,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:13,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:13,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:13,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:13,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 14:03:13,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:13,037 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675778623038 2023-02-07 14:03:13,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 14:03:13,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 14:03:13,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 14:03:13,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 14:03:13,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 14:03:13,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 14:03:13,039 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:13,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,040 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 14:03:13,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 14:03:13,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 14:03:13,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 14:03:13,041 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:13,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 14:03:13,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 14:03:13,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778593044,5,FailOnTimeoutGroup] 2023-02-07 14:03:13,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778593044,5,FailOnTimeoutGroup] 2023-02-07 14:03:13,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 14:03:13,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,052 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:13,052 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:13,052 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97 2023-02-07 14:03:13,061 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:13,064 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:03:13,065 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/info 2023-02-07 14:03:13,066 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:03:13,066 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:13,066 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:03:13,067 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:13,068 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:03:13,068 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:13,068 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:03:13,069 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/table 2023-02-07 14:03:13,069 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:03:13,070 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:13,070 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740 2023-02-07 14:03:13,071 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740 2023-02-07 14:03:13,072 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:03:13,073 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:03:13,075 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:13,075 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65610091, jitterRate=-0.022333458065986633}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:03:13,075 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675778593062Initializing all the Stores at 1675778593062Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778593062Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778593064 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778593064Cleaning up temporary data from old regions at 1675778593071 (+7 ms)Cleaning up detritus from prior splits at 1675778593071Region opened successfully at 1675778593075 (+4 ms) 2023-02-07 14:03:13,075 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:03:13,075 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:03:13,075 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:03:13,075 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:03:13,075 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:03:13,075 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:13,075 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778593075Disabling compacts and flushes for region at 1675778593075Disabling writes for close at 1675778593075Writing region close event to WAL at 1675778593075Closed at 1675778593075 2023-02-07 14:03:13,076 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:13,076 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 14:03:13,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 14:03:13,078 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 14:03:13,079 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 14:03:13,093 INFO [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(952): ClusterId : 5b354903-2043-4ebb-96b7-1c549559bd51 2023-02-07 14:03:13,093 INFO [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(952): ClusterId : 5b354903-2043-4ebb-96b7-1c549559bd51 2023-02-07 14:03:13,093 DEBUG [RS:0;jenkins-hbase4:44239] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:03:13,093 DEBUG [RS:1;jenkins-hbase4:45365] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:03:13,095 DEBUG [RS:0;jenkins-hbase4:44239] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:03:13,095 DEBUG [RS:1;jenkins-hbase4:45365] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:03:13,095 DEBUG [RS:0;jenkins-hbase4:44239] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:03:13,095 DEBUG [RS:1;jenkins-hbase4:45365] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:03:13,098 DEBUG [RS:1;jenkins-hbase4:45365] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:03:13,099 DEBUG [RS:1;jenkins-hbase4:45365] zookeeper.ReadOnlyZKClient(139): Connect 0x185fde6c to 127.0.0.1:61542 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:13,099 DEBUG [RS:0;jenkins-hbase4:44239] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:03:13,101 DEBUG [RS:0;jenkins-hbase4:44239] zookeeper.ReadOnlyZKClient(139): Connect 0x43248399 to 127.0.0.1:61542 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:13,106 DEBUG [RS:1;jenkins-hbase4:45365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16983317, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:13,106 DEBUG [RS:1;jenkins-hbase4:45365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12a7b51c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:13,106 DEBUG [RS:0;jenkins-hbase4:44239] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4de3658d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:13,106 DEBUG [RS:0;jenkins-hbase4:44239] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49dce8e9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:13,115 DEBUG [RS:0;jenkins-hbase4:44239] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44239 2023-02-07 14:03:13,115 DEBUG [RS:1;jenkins-hbase4:45365] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45365 2023-02-07 14:03:13,115 INFO [RS:0;jenkins-hbase4:44239] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:03:13,115 INFO [RS:1;jenkins-hbase4:45365] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:03:13,115 INFO [RS:1;jenkins-hbase4:45365] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:03:13,115 INFO [RS:0;jenkins-hbase4:44239] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:03:13,116 DEBUG [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:03:13,116 DEBUG [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:03:13,116 INFO [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37885,1675778592755 with isa=jenkins-hbase4.apache.org/172.31.14.131:45365, startcode=1675778592875 2023-02-07 14:03:13,116 INFO [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,37885,1675778592755 with isa=jenkins-hbase4.apache.org/172.31.14.131:44239, startcode=1675778592805 2023-02-07 14:03:13,116 DEBUG [RS:1;jenkins-hbase4:45365] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:03:13,116 DEBUG [RS:0;jenkins-hbase4:44239] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:03:13,119 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41813, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:03:13,119 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59123, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:03:13,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37885] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:13,120 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:13,121 DEBUG [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97 2023-02-07 14:03:13,121 DEBUG [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38577 2023-02-07 14:03:13,121 DEBUG [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:03:13,121 DEBUG [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97 2023-02-07 14:03:13,121 DEBUG [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38577 2023-02-07 14:03:13,121 DEBUG [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:03:13,126 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:13,126 DEBUG [RS:1;jenkins-hbase4:45365] zookeeper.ZKUtil(162): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:13,126 DEBUG [RS:0;jenkins-hbase4:44239] zookeeper.ZKUtil(162): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:13,127 WARN [RS:1;jenkins-hbase4:45365] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:13,127 WARN [RS:0;jenkins-hbase4:44239] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:13,127 INFO [RS:1;jenkins-hbase4:45365] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:13,127 INFO [RS:0;jenkins-hbase4:44239] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:13,127 DEBUG [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/WALs/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:13,127 DEBUG [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/WALs/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:13,127 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44239,1675778592805] 2023-02-07 14:03:13,127 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45365,1675778592875] 2023-02-07 14:03:13,133 DEBUG [RS:0;jenkins-hbase4:44239] zookeeper.ZKUtil(162): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:13,133 DEBUG [RS:1;jenkins-hbase4:45365] zookeeper.ZKUtil(162): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:13,133 DEBUG [RS:0;jenkins-hbase4:44239] zookeeper.ZKUtil(162): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:13,133 DEBUG [RS:1;jenkins-hbase4:45365] zookeeper.ZKUtil(162): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:13,134 DEBUG [RS:0;jenkins-hbase4:44239] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:03:13,134 DEBUG [RS:1;jenkins-hbase4:45365] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:03:13,134 INFO [RS:1;jenkins-hbase4:45365] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:03:13,134 INFO [RS:0;jenkins-hbase4:44239] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:03:13,136 INFO [RS:1;jenkins-hbase4:45365] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:03:13,140 INFO [RS:1;jenkins-hbase4:45365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:03:13,140 INFO [RS:0;jenkins-hbase4:44239] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:03:13,140 INFO [RS:1;jenkins-hbase4:45365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,140 INFO [RS:0;jenkins-hbase4:44239] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:03:13,140 INFO [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:03:13,140 INFO [RS:0;jenkins-hbase4:44239] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,141 INFO [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:03:13,142 INFO [RS:1;jenkins-hbase4:45365] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,142 INFO [RS:0;jenkins-hbase4:44239] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,142 DEBUG [RS:1;jenkins-hbase4:45365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,142 DEBUG [RS:1;jenkins-hbase4:45365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,142 DEBUG [RS:0;jenkins-hbase4:44239] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,142 DEBUG [RS:1;jenkins-hbase4:45365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,142 DEBUG [RS:0;jenkins-hbase4:44239] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,142 DEBUG [RS:1;jenkins-hbase4:45365] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,142 DEBUG [RS:0;jenkins-hbase4:44239] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,142 DEBUG [RS:1;jenkins-hbase4:45365] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,143 DEBUG [RS:0;jenkins-hbase4:44239] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,143 DEBUG [RS:1;jenkins-hbase4:45365] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:13,143 DEBUG [RS:0;jenkins-hbase4:44239] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,143 DEBUG [RS:1;jenkins-hbase4:45365] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,143 DEBUG [RS:0;jenkins-hbase4:44239] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:13,143 DEBUG [RS:1;jenkins-hbase4:45365] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,143 DEBUG [RS:0;jenkins-hbase4:44239] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,143 DEBUG [RS:1;jenkins-hbase4:45365] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,143 DEBUG [RS:0;jenkins-hbase4:44239] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,143 DEBUG [RS:1;jenkins-hbase4:45365] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,143 DEBUG [RS:0;jenkins-hbase4:44239] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,143 DEBUG [RS:0;jenkins-hbase4:44239] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:13,147 INFO [RS:1;jenkins-hbase4:45365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,147 INFO [RS:1;jenkins-hbase4:45365] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,147 INFO [RS:1;jenkins-hbase4:45365] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,147 INFO [RS:0;jenkins-hbase4:44239] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,147 INFO [RS:0;jenkins-hbase4:44239] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,148 INFO [RS:0;jenkins-hbase4:44239] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,158 INFO [RS:1;jenkins-hbase4:45365] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:03:13,158 INFO [RS:1;jenkins-hbase4:45365] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45365,1675778592875-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,164 INFO [RS:0;jenkins-hbase4:44239] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:03:13,164 INFO [RS:0;jenkins-hbase4:44239] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44239,1675778592805-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,171 INFO [RS:1;jenkins-hbase4:45365] regionserver.Replication(203): jenkins-hbase4.apache.org,45365,1675778592875 started 2023-02-07 14:03:13,171 INFO [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45365,1675778592875, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45365, sessionid=0x1002f17f9a50002 2023-02-07 14:03:13,171 DEBUG [RS:1;jenkins-hbase4:45365] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:03:13,171 DEBUG [RS:1;jenkins-hbase4:45365] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:13,171 DEBUG [RS:1;jenkins-hbase4:45365] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45365,1675778592875' 2023-02-07 14:03:13,171 DEBUG [RS:1;jenkins-hbase4:45365] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:13,172 DEBUG [RS:1;jenkins-hbase4:45365] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:13,172 DEBUG [RS:1;jenkins-hbase4:45365] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:03:13,172 DEBUG [RS:1;jenkins-hbase4:45365] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:03:13,172 DEBUG [RS:1;jenkins-hbase4:45365] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:13,172 DEBUG [RS:1;jenkins-hbase4:45365] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45365,1675778592875' 2023-02-07 14:03:13,172 DEBUG [RS:1;jenkins-hbase4:45365] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:13,172 DEBUG [RS:1;jenkins-hbase4:45365] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:13,173 DEBUG [RS:1;jenkins-hbase4:45365] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:03:13,173 INFO [RS:1;jenkins-hbase4:45365] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:03:13,173 INFO [RS:1;jenkins-hbase4:45365] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:03:13,183 INFO [RS:0;jenkins-hbase4:44239] regionserver.Replication(203): jenkins-hbase4.apache.org,44239,1675778592805 started 2023-02-07 14:03:13,183 INFO [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44239,1675778592805, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44239, sessionid=0x1002f17f9a50001 2023-02-07 14:03:13,183 DEBUG [RS:0;jenkins-hbase4:44239] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:03:13,183 DEBUG [RS:0;jenkins-hbase4:44239] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:13,183 DEBUG [RS:0;jenkins-hbase4:44239] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44239,1675778592805' 2023-02-07 14:03:13,183 DEBUG [RS:0;jenkins-hbase4:44239] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:13,184 DEBUG [RS:0;jenkins-hbase4:44239] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:13,184 DEBUG [RS:0;jenkins-hbase4:44239] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:03:13,184 DEBUG [RS:0;jenkins-hbase4:44239] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:03:13,184 DEBUG [RS:0;jenkins-hbase4:44239] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:13,184 DEBUG [RS:0;jenkins-hbase4:44239] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44239,1675778592805' 2023-02-07 14:03:13,184 DEBUG [RS:0;jenkins-hbase4:44239] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:13,184 DEBUG [RS:0;jenkins-hbase4:44239] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:13,185 DEBUG [RS:0;jenkins-hbase4:44239] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:03:13,185 INFO [RS:0;jenkins-hbase4:44239] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:03:13,185 INFO [RS:0;jenkins-hbase4:44239] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:03:13,229 DEBUG [jenkins-hbase4:37885] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 14:03:13,229 DEBUG [jenkins-hbase4:37885] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:13,231 DEBUG [jenkins-hbase4:37885] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:13,231 DEBUG [jenkins-hbase4:37885] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:13,231 DEBUG [jenkins-hbase4:37885] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:13,232 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44239,1675778592805, state=OPENING 2023-02-07 14:03:13,233 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 14:03:13,234 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:13,234 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:03:13,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44239,1675778592805}] 2023-02-07 14:03:13,388 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:13,389 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 14:03:13,390 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47054, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 14:03:13,394 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 14:03:13,394 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:13,396 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44239%2C1675778592805.meta, suffix=.meta, logDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/WALs/jenkins-hbase4.apache.org,44239,1675778592805, archiveDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/oldWALs, maxLogs=32 2023-02-07 14:03:13,411 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44797,DS-25dec9ad-9539-43a5-9353-9adb0756f08f,DISK] 2023-02-07 14:03:13,411 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41435,DS-2d1e5a21-4bf3-4084-b855-a32b4ea8f4b3,DISK] 2023-02-07 14:03:13,413 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/WALs/jenkins-hbase4.apache.org,44239,1675778592805/jenkins-hbase4.apache.org%2C44239%2C1675778592805.meta.1675778593396.meta 2023-02-07 14:03:13,413 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44797,DS-25dec9ad-9539-43a5-9353-9adb0756f08f,DISK], DatanodeInfoWithStorage[127.0.0.1:41435,DS-2d1e5a21-4bf3-4084-b855-a32b4ea8f4b3,DISK]] 2023-02-07 14:03:13,413 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:13,413 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 14:03:13,413 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 14:03:13,413 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 14:03:13,413 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 14:03:13,413 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:13,414 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 14:03:13,414 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 14:03:13,415 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:03:13,415 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/info 2023-02-07 14:03:13,415 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/info 2023-02-07 14:03:13,416 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:03:13,416 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:13,416 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:03:13,417 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:13,417 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:13,417 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:03:13,418 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:13,418 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:03:13,418 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/table 2023-02-07 14:03:13,418 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/table 2023-02-07 14:03:13,418 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:03:13,419 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:13,419 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740 2023-02-07 14:03:13,420 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740 2023-02-07 14:03:13,422 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:03:13,422 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:03:13,423 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70710489, jitterRate=0.053668394684791565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:03:13,423 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675778593414Writing region info on filesystem at 1675778593414Initializing all the Stores at 1675778593414Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778593414Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778593414Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778593414Cleaning up temporary data from old regions at 1675778593421 (+7 ms)Cleaning up detritus from prior splits at 1675778593421Running coprocessor post-open hooks at 1675778593423 (+2 ms)Region opened successfully at 1675778593423 2023-02-07 14:03:13,424 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675778593388 2023-02-07 14:03:13,428 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 14:03:13,429 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 14:03:13,429 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44239,1675778592805, state=OPEN 2023-02-07 14:03:13,430 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 14:03:13,431 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:03:13,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 14:03:13,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44239,1675778592805 in 196 msec 2023-02-07 14:03:13,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 14:03:13,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-07 14:03:13,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 398 msec 2023-02-07 14:03:13,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675778592894, completionTime=-1 2023-02-07 14:03:13,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 14:03:13,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 14:03:13,438 DEBUG [hconnection-0x5b530c16-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:13,439 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47070, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:13,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 14:03:13,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675778653441 2023-02-07 14:03:13,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675778713441 2023-02-07 14:03:13,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-07 14:03:13,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37885,1675778592755-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37885,1675778592755-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37885,1675778592755-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37885, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:13,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 14:03:13,449 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:13,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 14:03:13,450 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 14:03:13,450 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:03:13,451 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:03:13,452 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/hbase/namespace/d0f8dcc1231b534c2c3ae41c805f78db 2023-02-07 14:03:13,453 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/hbase/namespace/d0f8dcc1231b534c2c3ae41c805f78db empty. 2023-02-07 14:03:13,453 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/hbase/namespace/d0f8dcc1231b534c2c3ae41c805f78db 2023-02-07 14:03:13,453 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 14:03:13,463 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:13,468 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d0f8dcc1231b534c2c3ae41c805f78db, NAME => 'hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp 2023-02-07 14:03:13,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:13,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d0f8dcc1231b534c2c3ae41c805f78db, disabling compactions & flushes 2023-02-07 14:03:13,481 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. 2023-02-07 14:03:13,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. 2023-02-07 14:03:13,481 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. after waiting 0 ms 2023-02-07 14:03:13,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. 2023-02-07 14:03:13,482 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. 2023-02-07 14:03:13,482 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d0f8dcc1231b534c2c3ae41c805f78db: Waiting for close lock at 1675778593481Disabling compacts and flushes for region at 1675778593481Disabling writes for close at 1675778593482 (+1 ms)Writing region close event to WAL at 1675778593482Closed at 1675778593482 2023-02-07 14:03:13,484 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:03:13,485 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778593485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778593485"}]},"ts":"1675778593485"} 2023-02-07 14:03:13,487 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 14:03:13,488 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:03:13,488 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778593488"}]},"ts":"1675778593488"} 2023-02-07 14:03:13,489 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 14:03:13,492 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:13,493 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:13,493 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:13,493 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:13,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d0f8dcc1231b534c2c3ae41c805f78db, ASSIGN}] 2023-02-07 14:03:13,499 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d0f8dcc1231b534c2c3ae41c805f78db, ASSIGN 2023-02-07 14:03:13,500 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d0f8dcc1231b534c2c3ae41c805f78db, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45365,1675778592875; forceNewPlan=false, retain=false 2023-02-07 14:03:13,650 INFO [jenkins-hbase4:37885] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 14:03:13,651 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d0f8dcc1231b534c2c3ae41c805f78db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:13,651 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778593651"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778593651"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778593651"}]},"ts":"1675778593651"} 2023-02-07 14:03:13,653 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d0f8dcc1231b534c2c3ae41c805f78db, server=jenkins-hbase4.apache.org,45365,1675778592875}] 2023-02-07 14:03:13,806 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:13,806 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 14:03:13,807 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58848, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 14:03:13,811 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. 2023-02-07 14:03:13,813 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45365%2C1675778592875, suffix=, logDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/WALs/jenkins-hbase4.apache.org,45365,1675778592875, archiveDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/oldWALs, maxLogs=32 2023-02-07 14:03:13,827 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41435,DS-2d1e5a21-4bf3-4084-b855-a32b4ea8f4b3,DISK] 2023-02-07 14:03:13,827 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44797,DS-25dec9ad-9539-43a5-9353-9adb0756f08f,DISK] 2023-02-07 14:03:13,829 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/WALs/jenkins-hbase4.apache.org,45365,1675778592875/jenkins-hbase4.apache.org%2C45365%2C1675778592875.1675778593813 2023-02-07 14:03:13,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44797,DS-25dec9ad-9539-43a5-9353-9adb0756f08f,DISK], DatanodeInfoWithStorage[127.0.0.1:41435,DS-2d1e5a21-4bf3-4084-b855-a32b4ea8f4b3,DISK]] 2023-02-07 14:03:13,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d0f8dcc1231b534c2c3ae41c805f78db, NAME => 'hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:13,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d0f8dcc1231b534c2c3ae41c805f78db 2023-02-07 14:03:13,834 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:13,835 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d0f8dcc1231b534c2c3ae41c805f78db 2023-02-07 14:03:13,835 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d0f8dcc1231b534c2c3ae41c805f78db 2023-02-07 14:03:13,836 INFO [StoreOpener-d0f8dcc1231b534c2c3ae41c805f78db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d0f8dcc1231b534c2c3ae41c805f78db 2023-02-07 14:03:13,837 DEBUG [StoreOpener-d0f8dcc1231b534c2c3ae41c805f78db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/namespace/d0f8dcc1231b534c2c3ae41c805f78db/info 2023-02-07 14:03:13,837 DEBUG [StoreOpener-d0f8dcc1231b534c2c3ae41c805f78db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/namespace/d0f8dcc1231b534c2c3ae41c805f78db/info 2023-02-07 14:03:13,837 INFO [StoreOpener-d0f8dcc1231b534c2c3ae41c805f78db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0f8dcc1231b534c2c3ae41c805f78db columnFamilyName info 2023-02-07 14:03:13,838 INFO [StoreOpener-d0f8dcc1231b534c2c3ae41c805f78db-1] regionserver.HStore(310): Store=d0f8dcc1231b534c2c3ae41c805f78db/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:13,839 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/namespace/d0f8dcc1231b534c2c3ae41c805f78db 2023-02-07 14:03:13,839 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/namespace/d0f8dcc1231b534c2c3ae41c805f78db 2023-02-07 14:03:13,841 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d0f8dcc1231b534c2c3ae41c805f78db 2023-02-07 14:03:13,844 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/namespace/d0f8dcc1231b534c2c3ae41c805f78db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:13,845 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d0f8dcc1231b534c2c3ae41c805f78db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58947065, jitterRate=-0.1216202825307846}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:03:13,845 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d0f8dcc1231b534c2c3ae41c805f78db: Running coprocessor pre-open hook at 1675778593835Writing region info on filesystem at 1675778593835Initializing all the Stores at 1675778593835Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778593835Cleaning up temporary data from old regions at 1675778593839 (+4 ms)Cleaning up detritus from prior splits at 1675778593840 (+1 ms)Running coprocessor post-open hooks at 1675778593845 (+5 ms)Region opened successfully at 1675778593845 2023-02-07 14:03:13,846 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db., pid=6, masterSystemTime=1675778593806 2023-02-07 14:03:13,850 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. 2023-02-07 14:03:13,851 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. 2023-02-07 14:03:13,851 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d0f8dcc1231b534c2c3ae41c805f78db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:13,851 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778593851"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778593851"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778593851"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778593851"}]},"ts":"1675778593851"} 2023-02-07 14:03:13,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 14:03:13,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d0f8dcc1231b534c2c3ae41c805f78db, server=jenkins-hbase4.apache.org,45365,1675778592875 in 200 msec 2023-02-07 14:03:13,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 14:03:13,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d0f8dcc1231b534c2c3ae41c805f78db, ASSIGN in 361 msec 2023-02-07 14:03:13,856 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:03:13,857 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778593856"}]},"ts":"1675778593856"} 2023-02-07 14:03:13,858 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 14:03:13,861 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:03:13,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 412 msec 2023-02-07 14:03:13,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 14:03:13,952 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:13,952 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:13,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:13,955 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:13,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 14:03:13,966 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:13,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 10 msec 2023-02-07 14:03:13,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 14:03:13,987 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:13,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-07 14:03:13,993 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 14:03:13,996 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 14:03:13,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.097sec 2023-02-07 14:03:13,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 14:03:13,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 14:03:13,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 14:03:13,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37885,1675778592755-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 14:03:13,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37885,1675778592755-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 14:03:13,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 14:03:14,049 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 14:03:14,093 DEBUG [Listener at localhost/45865] zookeeper.ReadOnlyZKClient(139): Connect 0x49122599 to 127.0.0.1:61542 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:14,101 DEBUG [Listener at localhost/45865] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bae28e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:14,104 DEBUG [hconnection-0x593c54d0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:14,109 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47086, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:14,111 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37885,1675778592755 2023-02-07 14:03:14,112 DEBUG [Listener at localhost/45865] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 14:03:14,112 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:14,112 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:14,114 DEBUG [Listener at localhost/45865] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 14:03:14,116 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35656, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 14:03:14,118 INFO [Listener at localhost/45865] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-07 14:03:14,118 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-07 14:03:14,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 14:03:14,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:35656 deadline: 1675778654118, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-07 14:03:14,119 INFO [Listener at localhost/45865] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-07 14:03:14,119 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:14,119 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:14,124 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:14,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:14,127 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:03:14,128 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-07 14:03:14,128 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:03:14,130 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:14,131 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:14,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:14,142 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:14,142 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:14,142 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:14,143 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:14,142 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:14,143 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec empty. 2023-02-07 14:03:14,142 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:14,143 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:14,143 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a empty. 2023-02-07 14:03:14,143 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:14,143 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8 empty. 2023-02-07 14:03:14,144 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c empty. 2023-02-07 14:03:14,144 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2 empty. 2023-02-07 14:03:14,144 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:14,144 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8 2023-02-07 14:03:14,144 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b empty. 2023-02-07 14:03:14,145 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:14,145 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:14,145 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8 empty. 2023-02-07 14:03:14,145 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4 empty. 2023-02-07 14:03:14,145 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08 empty. 2023-02-07 14:03:14,146 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:14,146 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:14,146 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8 empty. 2023-02-07 14:03:14,146 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:14,146 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:14,146 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:14,146 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:14,146 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:14,147 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8 2023-02-07 14:03:14,147 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-07 14:03:14,159 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:14,161 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 6a24f898703d5e53fde0a818f5deba08, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp 2023-02-07 14:03:14,161 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 817b819a97bae6e7ccdc3339bba18bec, NAME => 'testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp 2023-02-07 14:03:14,161 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8db3168d240af3f198f5e5aee2b07fe8, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp 2023-02-07 14:03:14,176 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,176 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 6a24f898703d5e53fde0a818f5deba08, disabling compactions & flushes 2023-02-07 14:03:14,176 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:14,176 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:14,177 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. after waiting 0 ms 2023-02-07 14:03:14,177 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:14,177 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:14,177 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 6a24f898703d5e53fde0a818f5deba08: Waiting for close lock at 1675778594176Disabling compacts and flushes for region at 1675778594176Disabling writes for close at 1675778594177 (+1 ms)Writing region close event to WAL at 1675778594177Closed at 1675778594177 2023-02-07 14:03:14,177 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => bc79e3a18b31e18d3202857c81987c1c, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp 2023-02-07 14:03:14,179 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,179 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 817b819a97bae6e7ccdc3339bba18bec, disabling compactions & flushes 2023-02-07 14:03:14,179 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:14,179 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:14,179 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. after waiting 0 ms 2023-02-07 14:03:14,179 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:14,179 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:14,179 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 817b819a97bae6e7ccdc3339bba18bec: Waiting for close lock at 1675778594179Disabling compacts and flushes for region at 1675778594179Disabling writes for close at 1675778594179Writing region close event to WAL at 1675778594179Closed at 1675778594179 2023-02-07 14:03:14,179 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => cd032384c7aae39dc559f0ab4870f85a, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp 2023-02-07 14:03:14,180 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,180 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 8db3168d240af3f198f5e5aee2b07fe8, disabling compactions & flushes 2023-02-07 14:03:14,180 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:14,180 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:14,180 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. after waiting 0 ms 2023-02-07 14:03:14,180 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:14,180 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:14,180 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 8db3168d240af3f198f5e5aee2b07fe8: Waiting for close lock at 1675778594180Disabling compacts and flushes for region at 1675778594180Disabling writes for close at 1675778594180Writing region close event to WAL at 1675778594180Closed at 1675778594180 2023-02-07 14:03:14,181 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3d27aaddb20d932428863d8eda2399b2, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp 2023-02-07 14:03:14,186 INFO [RS:0;jenkins-hbase4:44239] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44239%2C1675778592805, suffix=, logDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/WALs/jenkins-hbase4.apache.org,44239,1675778592805, archiveDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/oldWALs, maxLogs=32 2023-02-07 14:03:14,188 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,188 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing bc79e3a18b31e18d3202857c81987c1c, disabling compactions & flushes 2023-02-07 14:03:14,188 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:14,188 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:14,188 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. after waiting 0 ms 2023-02-07 14:03:14,188 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:14,188 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:14,188 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for bc79e3a18b31e18d3202857c81987c1c: Waiting for close lock at 1675778594188Disabling compacts and flushes for region at 1675778594188Disabling writes for close at 1675778594188Writing region close event to WAL at 1675778594188Closed at 1675778594188 2023-02-07 14:03:14,189 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8cac1335a37cfd271778dece578dc88b, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp 2023-02-07 14:03:14,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing cd032384c7aae39dc559f0ab4870f85a, disabling compactions & flushes 2023-02-07 14:03:14,200 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:14,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:14,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. after waiting 0 ms 2023-02-07 14:03:14,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:14,200 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:14,200 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for cd032384c7aae39dc559f0ab4870f85a: Waiting for close lock at 1675778594200Disabling compacts and flushes for region at 1675778594200Disabling writes for close at 1675778594200Writing region close event to WAL at 1675778594200Closed at 1675778594200 2023-02-07 14:03:14,201 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 56002cf8b83f4276529438d13b773bb8, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp 2023-02-07 14:03:14,205 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41435,DS-2d1e5a21-4bf3-4084-b855-a32b4ea8f4b3,DISK] 2023-02-07 14:03:14,205 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44797,DS-25dec9ad-9539-43a5-9353-9adb0756f08f,DISK] 2023-02-07 14:03:14,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 3d27aaddb20d932428863d8eda2399b2, disabling compactions & flushes 2023-02-07 14:03:14,212 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:14,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:14,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. after waiting 0 ms 2023-02-07 14:03:14,212 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:14,212 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:14,213 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 3d27aaddb20d932428863d8eda2399b2: Waiting for close lock at 1675778594212Disabling compacts and flushes for region at 1675778594212Disabling writes for close at 1675778594212Writing region close event to WAL at 1675778594212Closed at 1675778594212 2023-02-07 14:03:14,213 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1480baf3a921359925457313a52e67f8, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp 2023-02-07 14:03:14,222 INFO [RS:0;jenkins-hbase4:44239] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/WALs/jenkins-hbase4.apache.org,44239,1675778592805/jenkins-hbase4.apache.org%2C44239%2C1675778592805.1675778594187 2023-02-07 14:03:14,226 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,227 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 8cac1335a37cfd271778dece578dc88b, disabling compactions & flushes 2023-02-07 14:03:14,227 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:14,227 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:14,227 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. after waiting 0 ms 2023-02-07 14:03:14,227 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:14,227 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:14,227 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 8cac1335a37cfd271778dece578dc88b: Waiting for close lock at 1675778594227Disabling compacts and flushes for region at 1675778594227Disabling writes for close at 1675778594227Writing region close event to WAL at 1675778594227Closed at 1675778594227 2023-02-07 14:03:14,227 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7b537e9af0f831a97df0ff3a15af9fe4, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp 2023-02-07 14:03:14,228 DEBUG [RS:0;jenkins-hbase4:44239] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41435,DS-2d1e5a21-4bf3-4084-b855-a32b4ea8f4b3,DISK], DatanodeInfoWithStorage[127.0.0.1:44797,DS-25dec9ad-9539-43a5-9353-9adb0756f08f,DISK]] 2023-02-07 14:03:14,232 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,232 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,232 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 56002cf8b83f4276529438d13b773bb8, disabling compactions & flushes 2023-02-07 14:03:14,232 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 1480baf3a921359925457313a52e67f8, disabling compactions & flushes 2023-02-07 14:03:14,232 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:14,232 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:14,233 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:14,232 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:14,233 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. after waiting 0 ms 2023-02-07 14:03:14,233 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:14,233 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:14,233 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:14,233 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:14,233 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 1480baf3a921359925457313a52e67f8: Waiting for close lock at 1675778594232Disabling compacts and flushes for region at 1675778594232Disabling writes for close at 1675778594233 (+1 ms)Writing region close event to WAL at 1675778594233Closed at 1675778594233 2023-02-07 14:03:14,233 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. after waiting 0 ms 2023-02-07 14:03:14,233 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:14,233 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:14,233 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 56002cf8b83f4276529438d13b773bb8: Waiting for close lock at 1675778594232Disabling compacts and flushes for region at 1675778594232Disabling writes for close at 1675778594233 (+1 ms)Writing region close event to WAL at 1675778594233Closed at 1675778594233 2023-02-07 14:03:14,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:14,242 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,242 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 7b537e9af0f831a97df0ff3a15af9fe4, disabling compactions & flushes 2023-02-07 14:03:14,242 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:14,242 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:14,242 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. after waiting 0 ms 2023-02-07 14:03:14,242 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:14,242 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:14,242 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 7b537e9af0f831a97df0ff3a15af9fe4: Waiting for close lock at 1675778594242Disabling compacts and flushes for region at 1675778594242Disabling writes for close at 1675778594242Writing region close event to WAL at 1675778594242Closed at 1675778594242 2023-02-07 14:03:14,244 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:03:14,245 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778594245"}]},"ts":"1675778594245"} 2023-02-07 14:03:14,245 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675778594245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778594245"}]},"ts":"1675778594245"} 2023-02-07 14:03:14,245 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778594245"}]},"ts":"1675778594245"} 2023-02-07 14:03:14,245 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778594245"}]},"ts":"1675778594245"} 2023-02-07 14:03:14,245 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778594245"}]},"ts":"1675778594245"} 2023-02-07 14:03:14,245 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778594245"}]},"ts":"1675778594245"} 2023-02-07 14:03:14,245 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778594245"}]},"ts":"1675778594245"} 2023-02-07 14:03:14,245 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778594245"}]},"ts":"1675778594245"} 2023-02-07 14:03:14,246 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778594245"}]},"ts":"1675778594245"} 2023-02-07 14:03:14,246 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675778594245"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778594245"}]},"ts":"1675778594245"} 2023-02-07 14:03:14,248 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-07 14:03:14,249 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:03:14,249 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778594249"}]},"ts":"1675778594249"} 2023-02-07 14:03:14,250 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-07 14:03:14,253 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:14,259 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:14,259 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:14,259 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:14,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=817b819a97bae6e7ccdc3339bba18bec, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8db3168d240af3f198f5e5aee2b07fe8, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a24f898703d5e53fde0a818f5deba08, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc79e3a18b31e18d3202857c81987c1c, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cd032384c7aae39dc559f0ab4870f85a, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3d27aaddb20d932428863d8eda2399b2, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8cac1335a37cfd271778dece578dc88b, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=56002cf8b83f4276529438d13b773bb8, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1480baf3a921359925457313a52e67f8, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b537e9af0f831a97df0ff3a15af9fe4, ASSIGN}] 2023-02-07 14:03:14,262 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8db3168d240af3f198f5e5aee2b07fe8, ASSIGN 2023-02-07 14:03:14,262 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=817b819a97bae6e7ccdc3339bba18bec, ASSIGN 2023-02-07 14:03:14,262 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a24f898703d5e53fde0a818f5deba08, ASSIGN 2023-02-07 14:03:14,262 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc79e3a18b31e18d3202857c81987c1c, ASSIGN 2023-02-07 14:03:14,262 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8db3168d240af3f198f5e5aee2b07fe8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45365,1675778592875; forceNewPlan=false, retain=false 2023-02-07 14:03:14,263 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a24f898703d5e53fde0a818f5deba08, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45365,1675778592875; forceNewPlan=false, retain=false 2023-02-07 14:03:14,263 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=817b819a97bae6e7ccdc3339bba18bec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44239,1675778592805; forceNewPlan=false, retain=false 2023-02-07 14:03:14,263 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc79e3a18b31e18d3202857c81987c1c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44239,1675778592805; forceNewPlan=false, retain=false 2023-02-07 14:03:14,263 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b537e9af0f831a97df0ff3a15af9fe4, ASSIGN 2023-02-07 14:03:14,263 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1480baf3a921359925457313a52e67f8, ASSIGN 2023-02-07 14:03:14,263 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=56002cf8b83f4276529438d13b773bb8, ASSIGN 2023-02-07 14:03:14,263 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8cac1335a37cfd271778dece578dc88b, ASSIGN 2023-02-07 14:03:14,264 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3d27aaddb20d932428863d8eda2399b2, ASSIGN 2023-02-07 14:03:14,264 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b537e9af0f831a97df0ff3a15af9fe4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44239,1675778592805; forceNewPlan=false, retain=false 2023-02-07 14:03:14,264 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1480baf3a921359925457313a52e67f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44239,1675778592805; forceNewPlan=false, retain=false 2023-02-07 14:03:14,264 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=56002cf8b83f4276529438d13b773bb8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45365,1675778592875; forceNewPlan=false, retain=false 2023-02-07 14:03:14,264 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8cac1335a37cfd271778dece578dc88b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45365,1675778592875; forceNewPlan=false, retain=false 2023-02-07 14:03:14,265 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3d27aaddb20d932428863d8eda2399b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44239,1675778592805; forceNewPlan=false, retain=false 2023-02-07 14:03:14,265 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cd032384c7aae39dc559f0ab4870f85a, ASSIGN 2023-02-07 14:03:14,265 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cd032384c7aae39dc559f0ab4870f85a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45365,1675778592875; forceNewPlan=false, retain=false 2023-02-07 14:03:14,413 INFO [jenkins-hbase4:37885] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-07 14:03:14,419 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=8db3168d240af3f198f5e5aee2b07fe8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:14,419 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=cd032384c7aae39dc559f0ab4870f85a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:14,419 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=6a24f898703d5e53fde0a818f5deba08, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:14,419 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778594419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778594419"}]},"ts":"1675778594419"} 2023-02-07 14:03:14,419 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=56002cf8b83f4276529438d13b773bb8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:14,419 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=8cac1335a37cfd271778dece578dc88b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:14,419 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778594419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778594419"}]},"ts":"1675778594419"} 2023-02-07 14:03:14,419 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778594419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778594419"}]},"ts":"1675778594419"} 2023-02-07 14:03:14,419 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778594419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778594419"}]},"ts":"1675778594419"} 2023-02-07 14:03:14,419 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594419"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778594419"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778594419"}]},"ts":"1675778594419"} 2023-02-07 14:03:14,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=15, state=RUNNABLE; OpenRegionProcedure cd032384c7aae39dc559f0ab4870f85a, server=jenkins-hbase4.apache.org,45365,1675778592875}] 2023-02-07 14:03:14,424 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7b537e9af0f831a97df0ff3a15af9fe4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:14,425 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675778594424"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778594424"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778594424"}]},"ts":"1675778594424"} 2023-02-07 14:03:14,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=13, state=RUNNABLE; OpenRegionProcedure 6a24f898703d5e53fde0a818f5deba08, server=jenkins-hbase4.apache.org,45365,1675778592875}] 2023-02-07 14:03:14,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=12, state=RUNNABLE; OpenRegionProcedure 8db3168d240af3f198f5e5aee2b07fe8, server=jenkins-hbase4.apache.org,45365,1675778592875}] 2023-02-07 14:03:14,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE; OpenRegionProcedure 56002cf8b83f4276529438d13b773bb8, server=jenkins-hbase4.apache.org,45365,1675778592875}] 2023-02-07 14:03:14,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure 8cac1335a37cfd271778dece578dc88b, server=jenkins-hbase4.apache.org,45365,1675778592875}] 2023-02-07 14:03:14,428 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure 7b537e9af0f831a97df0ff3a15af9fe4, server=jenkins-hbase4.apache.org,44239,1675778592805}] 2023-02-07 14:03:14,430 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3d27aaddb20d932428863d8eda2399b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:14,430 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778594430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778594430"}]},"ts":"1675778594430"} 2023-02-07 14:03:14,430 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=1480baf3a921359925457313a52e67f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:14,430 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778594430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778594430"}]},"ts":"1675778594430"} 2023-02-07 14:03:14,430 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=bc79e3a18b31e18d3202857c81987c1c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:14,431 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778594430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778594430"}]},"ts":"1675778594430"} 2023-02-07 14:03:14,431 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=817b819a97bae6e7ccdc3339bba18bec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:14,431 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675778594431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778594431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778594431"}]},"ts":"1675778594431"} 2023-02-07 14:03:14,432 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=16, state=RUNNABLE; OpenRegionProcedure 3d27aaddb20d932428863d8eda2399b2, server=jenkins-hbase4.apache.org,44239,1675778592805}] 2023-02-07 14:03:14,433 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure 1480baf3a921359925457313a52e67f8, server=jenkins-hbase4.apache.org,44239,1675778592805}] 2023-02-07 14:03:14,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure bc79e3a18b31e18d3202857c81987c1c, server=jenkins-hbase4.apache.org,44239,1675778592805}] 2023-02-07 14:03:14,434 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:14,435 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:14,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure 817b819a97bae6e7ccdc3339bba18bec, server=jenkins-hbase4.apache.org,44239,1675778592805}] 2023-02-07 14:03:14,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:14,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:14,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8db3168d240af3f198f5e5aee2b07fe8, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-07 14:03:14,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:14,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:14,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:14,579 INFO [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:14,580 DEBUG [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1 2023-02-07 14:03:14,580 DEBUG [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1 2023-02-07 14:03:14,581 INFO [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8db3168d240af3f198f5e5aee2b07fe8 columnFamilyName f1 2023-02-07 14:03:14,581 INFO [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] regionserver.HStore(310): Store=8db3168d240af3f198f5e5aee2b07fe8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,581 INFO [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:14,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:14,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3d27aaddb20d932428863d8eda2399b2, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-07 14:03:14,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:14,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:14,583 DEBUG [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2 2023-02-07 14:03:14,583 DEBUG [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2 2023-02-07 14:03:14,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:14,583 INFO [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8db3168d240af3f198f5e5aee2b07fe8 columnFamilyName f2 2023-02-07 14:03:14,584 INFO [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] regionserver.HStore(310): Store=8db3168d240af3f198f5e5aee2b07fe8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,584 INFO [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:14,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:14,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:14,585 DEBUG [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1 2023-02-07 14:03:14,585 DEBUG [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1 2023-02-07 14:03:14,586 INFO [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d27aaddb20d932428863d8eda2399b2 columnFamilyName f1 2023-02-07 14:03:14,586 INFO [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] regionserver.HStore(310): Store=3d27aaddb20d932428863d8eda2399b2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,586 INFO [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:14,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:14,587 DEBUG [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2 2023-02-07 14:03:14,587 DEBUG [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2 2023-02-07 14:03:14,587 INFO [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d27aaddb20d932428863d8eda2399b2 columnFamilyName f2 2023-02-07 14:03:14,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:14,588 INFO [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] regionserver.HStore(310): Store=3d27aaddb20d932428863d8eda2399b2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:14,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:14,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:14,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8db3168d240af3f198f5e5aee2b07fe8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66174263, jitterRate=-0.013926640152931213}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:14,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8db3168d240af3f198f5e5aee2b07fe8: Running coprocessor pre-open hook at 1675778594578Writing region info on filesystem at 1675778594578Initializing all the Stores at 1675778594578Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594578Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594579 (+1 ms)Cleaning up temporary data from old regions at 1675778594585 (+6 ms)Cleaning up detritus from prior splits at 1675778594586 (+1 ms)Running coprocessor post-open hooks at 1675778594590 (+4 ms)Region opened successfully at 1675778594590 2023-02-07 14:03:14,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:14,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8., pid=23, masterSystemTime=1675778594574 2023-02-07 14:03:14,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:14,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:14,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:14,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:14,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6a24f898703d5e53fde0a818f5deba08, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-07 14:03:14,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:14,593 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=8db3168d240af3f198f5e5aee2b07fe8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:14,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:14,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:14,593 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594593"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778594593"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778594593"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778594593"}]},"ts":"1675778594593"} 2023-02-07 14:03:14,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:14,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3d27aaddb20d932428863d8eda2399b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68898748, jitterRate=0.02667135000228882}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:14,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3d27aaddb20d932428863d8eda2399b2: Running coprocessor pre-open hook at 1675778594583Writing region info on filesystem at 1675778594583Initializing all the Stores at 1675778594584 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594584Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594584Cleaning up temporary data from old regions at 1675778594589 (+5 ms)Cleaning up detritus from prior splits at 1675778594589Running coprocessor post-open hooks at 1675778594594 (+5 ms)Region opened successfully at 1675778594594 2023-02-07 14:03:14,594 INFO [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:14,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2., pid=27, masterSystemTime=1675778594580 2023-02-07 14:03:14,595 DEBUG [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1 2023-02-07 14:03:14,595 DEBUG [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1 2023-02-07 14:03:14,596 INFO [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a24f898703d5e53fde0a818f5deba08 columnFamilyName f1 2023-02-07 14:03:14,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:14,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:14,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:14,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1480baf3a921359925457313a52e67f8, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-07 14:03:14,596 INFO [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] regionserver.HStore(310): Store=6a24f898703d5e53fde0a818f5deba08/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1480baf3a921359925457313a52e67f8 2023-02-07 14:03:14,596 INFO [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:14,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1480baf3a921359925457313a52e67f8 2023-02-07 14:03:14,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1480baf3a921359925457313a52e67f8 2023-02-07 14:03:14,596 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=12 2023-02-07 14:03:14,597 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3d27aaddb20d932428863d8eda2399b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:14,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=12, state=SUCCESS; OpenRegionProcedure 8db3168d240af3f198f5e5aee2b07fe8, server=jenkins-hbase4.apache.org,45365,1675778592875 in 167 msec 2023-02-07 14:03:14,597 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594596"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778594596"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778594596"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778594596"}]},"ts":"1675778594596"} 2023-02-07 14:03:14,598 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8db3168d240af3f198f5e5aee2b07fe8, ASSIGN in 337 msec 2023-02-07 14:03:14,598 INFO [StoreOpener-1480baf3a921359925457313a52e67f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1480baf3a921359925457313a52e67f8 2023-02-07 14:03:14,599 DEBUG [StoreOpener-1480baf3a921359925457313a52e67f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1 2023-02-07 14:03:14,599 DEBUG [StoreOpener-1480baf3a921359925457313a52e67f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1 2023-02-07 14:03:14,599 INFO [StoreOpener-1480baf3a921359925457313a52e67f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1480baf3a921359925457313a52e67f8 columnFamilyName f1 2023-02-07 14:03:14,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=16 2023-02-07 14:03:14,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=16, state=SUCCESS; OpenRegionProcedure 3d27aaddb20d932428863d8eda2399b2, server=jenkins-hbase4.apache.org,44239,1675778592805 in 166 msec 2023-02-07 14:03:14,599 INFO [StoreOpener-1480baf3a921359925457313a52e67f8-1] regionserver.HStore(310): Store=1480baf3a921359925457313a52e67f8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,600 INFO [StoreOpener-1480baf3a921359925457313a52e67f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1480baf3a921359925457313a52e67f8 2023-02-07 14:03:14,600 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3d27aaddb20d932428863d8eda2399b2, ASSIGN in 339 msec 2023-02-07 14:03:14,601 DEBUG [StoreOpener-1480baf3a921359925457313a52e67f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2 2023-02-07 14:03:14,601 DEBUG [StoreOpener-1480baf3a921359925457313a52e67f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2 2023-02-07 14:03:14,601 INFO [StoreOpener-1480baf3a921359925457313a52e67f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1480baf3a921359925457313a52e67f8 columnFamilyName f2 2023-02-07 14:03:14,601 INFO [StoreOpener-1480baf3a921359925457313a52e67f8-1] regionserver.HStore(310): Store=1480baf3a921359925457313a52e67f8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8 2023-02-07 14:03:14,602 DEBUG [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2 2023-02-07 14:03:14,602 DEBUG [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2 2023-02-07 14:03:14,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8 2023-02-07 14:03:14,602 INFO [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a24f898703d5e53fde0a818f5deba08 columnFamilyName f2 2023-02-07 14:03:14,603 INFO [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] regionserver.HStore(310): Store=6a24f898703d5e53fde0a818f5deba08/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:14,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:14,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:14,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1480baf3a921359925457313a52e67f8 2023-02-07 14:03:14,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:14,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:14,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:14,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1480baf3a921359925457313a52e67f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70115081, jitterRate=0.04479612410068512}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:14,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1480baf3a921359925457313a52e67f8: Running coprocessor pre-open hook at 1675778594596Writing region info on filesystem at 1675778594596Initializing all the Stores at 1675778594597 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594597Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594597Cleaning up temporary data from old regions at 1675778594603 (+6 ms)Cleaning up detritus from prior splits at 1675778594603Running coprocessor post-open hooks at 1675778594611 (+8 ms)Region opened successfully at 1675778594611 2023-02-07 14:03:14,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8., pid=28, masterSystemTime=1675778594580 2023-02-07 14:03:14,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:14,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6a24f898703d5e53fde0a818f5deba08; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58731175, jitterRate=-0.12483729422092438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:14,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6a24f898703d5e53fde0a818f5deba08: Running coprocessor pre-open hook at 1675778594593Writing region info on filesystem at 1675778594593Initializing all the Stores at 1675778594594 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594594Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594594Cleaning up temporary data from old regions at 1675778594604 (+10 ms)Cleaning up detritus from prior splits at 1675778594605 (+1 ms)Running coprocessor post-open hooks at 1675778594613 (+8 ms)Region opened successfully at 1675778594613 2023-02-07 14:03:14,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08., pid=22, masterSystemTime=1675778594574 2023-02-07 14:03:14,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:14,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:14,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:14,613 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=1480baf3a921359925457313a52e67f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:14,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7b537e9af0f831a97df0ff3a15af9fe4, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-07 14:03:14,614 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594613"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778594613"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778594613"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778594613"}]},"ts":"1675778594613"} 2023-02-07 14:03:14,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:14,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:14,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:14,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:14,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:14,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:14,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 56002cf8b83f4276529438d13b773bb8, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-07 14:03:14,618 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=6a24f898703d5e53fde0a818f5deba08, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:14,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:14,618 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594618"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778594618"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778594618"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778594618"}]},"ts":"1675778594618"} 2023-02-07 14:03:14,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:14,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:14,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-07 14:03:14,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure 1480baf3a921359925457313a52e67f8, server=jenkins-hbase4.apache.org,44239,1675778592805 in 186 msec 2023-02-07 14:03:14,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=13 2023-02-07 14:03:14,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=13, state=SUCCESS; OpenRegionProcedure 6a24f898703d5e53fde0a818f5deba08, server=jenkins-hbase4.apache.org,45365,1675778592875 in 193 msec 2023-02-07 14:03:14,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1480baf3a921359925457313a52e67f8, ASSIGN in 360 msec 2023-02-07 14:03:14,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a24f898703d5e53fde0a818f5deba08, ASSIGN in 361 msec 2023-02-07 14:03:14,624 INFO [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:14,624 INFO [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:14,625 DEBUG [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4/f1 2023-02-07 14:03:14,625 DEBUG [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4/f1 2023-02-07 14:03:14,625 DEBUG [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1 2023-02-07 14:03:14,625 DEBUG [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1 2023-02-07 14:03:14,625 INFO [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b537e9af0f831a97df0ff3a15af9fe4 columnFamilyName f1 2023-02-07 14:03:14,626 INFO [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56002cf8b83f4276529438d13b773bb8 columnFamilyName f1 2023-02-07 14:03:14,626 INFO [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] regionserver.HStore(310): Store=7b537e9af0f831a97df0ff3a15af9fe4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,626 INFO [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:14,626 INFO [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] regionserver.HStore(310): Store=56002cf8b83f4276529438d13b773bb8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,626 INFO [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:14,627 DEBUG [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4/f2 2023-02-07 14:03:14,627 DEBUG [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4/f2 2023-02-07 14:03:14,627 DEBUG [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2 2023-02-07 14:03:14,627 DEBUG [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2 2023-02-07 14:03:14,627 INFO [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b537e9af0f831a97df0ff3a15af9fe4 columnFamilyName f2 2023-02-07 14:03:14,628 INFO [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56002cf8b83f4276529438d13b773bb8 columnFamilyName f2 2023-02-07 14:03:14,628 INFO [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] regionserver.HStore(310): Store=7b537e9af0f831a97df0ff3a15af9fe4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,628 INFO [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] regionserver.HStore(310): Store=56002cf8b83f4276529438d13b773bb8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:14,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:14,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:14,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:14,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:14,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:14,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:14,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:14,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:14,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:14,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7b537e9af0f831a97df0ff3a15af9fe4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69601760, jitterRate=0.03714704513549805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:14,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 56002cf8b83f4276529438d13b773bb8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59567723, jitterRate=-0.11237175762653351}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:14,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7b537e9af0f831a97df0ff3a15af9fe4: Running coprocessor pre-open hook at 1675778594614Writing region info on filesystem at 1675778594614Initializing all the Stores at 1675778594615 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594615Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594624 (+9 ms)Cleaning up temporary data from old regions at 1675778594630 (+6 ms)Cleaning up detritus from prior splits at 1675778594630Running coprocessor post-open hooks at 1675778594634 (+4 ms)Region opened successfully at 1675778594634 2023-02-07 14:03:14,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 56002cf8b83f4276529438d13b773bb8: Running coprocessor pre-open hook at 1675778594619Writing region info on filesystem at 1675778594619Initializing all the Stores at 1675778594620 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594620Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594624 (+4 ms)Cleaning up temporary data from old regions at 1675778594630 (+6 ms)Cleaning up detritus from prior splits at 1675778594630Running coprocessor post-open hooks at 1675778594634 (+4 ms)Region opened successfully at 1675778594634 2023-02-07 14:03:14,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4., pid=26, masterSystemTime=1675778594580 2023-02-07 14:03:14,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8., pid=24, masterSystemTime=1675778594574 2023-02-07 14:03:14,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:14,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:14,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:14,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cd032384c7aae39dc559f0ab4870f85a, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-07 14:03:14,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:14,636 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=56002cf8b83f4276529438d13b773bb8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:14,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:14,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:14,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:14,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:14,637 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594636"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778594636"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778594636"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778594636"}]},"ts":"1675778594636"} 2023-02-07 14:03:14,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 817b819a97bae6e7ccdc3339bba18bec, NAME => 'testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-07 14:03:14,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:14,637 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7b537e9af0f831a97df0ff3a15af9fe4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:14,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:14,637 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675778594637"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778594637"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778594637"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778594637"}]},"ts":"1675778594637"} 2023-02-07 14:03:14,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:14,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:14,638 INFO [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:14,639 INFO [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:14,640 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-02-07 14:03:14,640 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; OpenRegionProcedure 56002cf8b83f4276529438d13b773bb8, server=jenkins-hbase4.apache.org,45365,1675778592875 in 211 msec 2023-02-07 14:03:14,640 DEBUG [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1 2023-02-07 14:03:14,640 DEBUG [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1 2023-02-07 14:03:14,640 INFO [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd032384c7aae39dc559f0ab4870f85a columnFamilyName f1 2023-02-07 14:03:14,641 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-07 14:03:14,641 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure 7b537e9af0f831a97df0ff3a15af9fe4, server=jenkins-hbase4.apache.org,44239,1675778592805 in 211 msec 2023-02-07 14:03:14,641 DEBUG [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec/f1 2023-02-07 14:03:14,641 DEBUG [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec/f1 2023-02-07 14:03:14,641 INFO [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 817b819a97bae6e7ccdc3339bba18bec columnFamilyName f1 2023-02-07 14:03:14,642 INFO [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] regionserver.HStore(310): Store=cd032384c7aae39dc559f0ab4870f85a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,642 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=56002cf8b83f4276529438d13b773bb8, ASSIGN in 380 msec 2023-02-07 14:03:14,642 INFO [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:14,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b537e9af0f831a97df0ff3a15af9fe4, ASSIGN in 381 msec 2023-02-07 14:03:14,644 INFO [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] regionserver.HStore(310): Store=817b819a97bae6e7ccdc3339bba18bec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,644 INFO [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:14,645 DEBUG [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2 2023-02-07 14:03:14,645 DEBUG [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2 2023-02-07 14:03:14,645 INFO [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd032384c7aae39dc559f0ab4870f85a columnFamilyName f2 2023-02-07 14:03:14,645 DEBUG [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec/f2 2023-02-07 14:03:14,645 INFO [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] regionserver.HStore(310): Store=cd032384c7aae39dc559f0ab4870f85a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,645 DEBUG [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec/f2 2023-02-07 14:03:14,646 INFO [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 817b819a97bae6e7ccdc3339bba18bec columnFamilyName f2 2023-02-07 14:03:14,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:14,646 INFO [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] regionserver.HStore(310): Store=817b819a97bae6e7ccdc3339bba18bec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:14,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:14,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:14,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:14,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:14,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:14,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:14,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:14,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:14,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cd032384c7aae39dc559f0ab4870f85a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59414648, jitterRate=-0.11465275287628174}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:14,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cd032384c7aae39dc559f0ab4870f85a: Running coprocessor pre-open hook at 1675778594637Writing region info on filesystem at 1675778594637Initializing all the Stores at 1675778594638 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594638Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594638Cleaning up temporary data from old regions at 1675778594647 (+9 ms)Cleaning up detritus from prior splits at 1675778594648 (+1 ms)Running coprocessor post-open hooks at 1675778594652 (+4 ms)Region opened successfully at 1675778594652 2023-02-07 14:03:14,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 817b819a97bae6e7ccdc3339bba18bec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66606643, jitterRate=-0.007483676075935364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:14,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 817b819a97bae6e7ccdc3339bba18bec: Running coprocessor pre-open hook at 1675778594637Writing region info on filesystem at 1675778594637Initializing all the Stores at 1675778594638 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594638Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594639 (+1 ms)Cleaning up temporary data from old regions at 1675778594648 (+9 ms)Cleaning up detritus from prior splits at 1675778594648Running coprocessor post-open hooks at 1675778594653 (+5 ms)Region opened successfully at 1675778594653 2023-02-07 14:03:14,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec., pid=30, masterSystemTime=1675778594580 2023-02-07 14:03:14,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a., pid=21, masterSystemTime=1675778594574 2023-02-07 14:03:14,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:14,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:14,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:14,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8cac1335a37cfd271778dece578dc88b, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-07 14:03:14,655 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=cd032384c7aae39dc559f0ab4870f85a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:14,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:14,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,656 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594655"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778594655"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778594655"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778594655"}]},"ts":"1675778594655"} 2023-02-07 14:03:14,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:14,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:14,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:14,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:14,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:14,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bc79e3a18b31e18d3202857c81987c1c, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-07 14:03:14,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:14,657 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=817b819a97bae6e7ccdc3339bba18bec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:14,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:14,657 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675778594657"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778594657"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778594657"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778594657"}]},"ts":"1675778594657"} 2023-02-07 14:03:14,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:14,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:14,658 INFO [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:14,659 INFO [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:14,659 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=15 2023-02-07 14:03:14,659 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=15, state=SUCCESS; OpenRegionProcedure cd032384c7aae39dc559f0ab4870f85a, server=jenkins-hbase4.apache.org,45365,1675778592875 in 236 msec 2023-02-07 14:03:14,660 DEBUG [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1 2023-02-07 14:03:14,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cd032384c7aae39dc559f0ab4870f85a, ASSIGN in 399 msec 2023-02-07 14:03:14,661 DEBUG [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1 2023-02-07 14:03:14,661 DEBUG [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1 2023-02-07 14:03:14,661 DEBUG [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1 2023-02-07 14:03:14,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-07 14:03:14,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure 817b819a97bae6e7ccdc3339bba18bec, server=jenkins-hbase4.apache.org,44239,1675778592805 in 224 msec 2023-02-07 14:03:14,661 INFO [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cac1335a37cfd271778dece578dc88b columnFamilyName f1 2023-02-07 14:03:14,662 INFO [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] regionserver.HStore(310): Store=8cac1335a37cfd271778dece578dc88b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,662 INFO [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:14,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=817b819a97bae6e7ccdc3339bba18bec, ASSIGN in 401 msec 2023-02-07 14:03:14,663 DEBUG [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2 2023-02-07 14:03:14,663 DEBUG [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2 2023-02-07 14:03:14,663 INFO [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cac1335a37cfd271778dece578dc88b columnFamilyName f2 2023-02-07 14:03:14,663 INFO [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] regionserver.HStore(310): Store=8cac1335a37cfd271778dece578dc88b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,664 INFO [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc79e3a18b31e18d3202857c81987c1c columnFamilyName f1 2023-02-07 14:03:14,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:14,664 INFO [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] regionserver.HStore(310): Store=bc79e3a18b31e18d3202857c81987c1c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,664 INFO [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:14,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:14,665 DEBUG [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2 2023-02-07 14:03:14,665 DEBUG [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2 2023-02-07 14:03:14,666 INFO [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc79e3a18b31e18d3202857c81987c1c columnFamilyName f2 2023-02-07 14:03:14,666 INFO [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] regionserver.HStore(310): Store=bc79e3a18b31e18d3202857c81987c1c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:14,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:14,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:14,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:14,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:14,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:14,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:14,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8cac1335a37cfd271778dece578dc88b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60040781, jitterRate=-0.10532264411449432}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:14,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:14,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8cac1335a37cfd271778dece578dc88b: Running coprocessor pre-open hook at 1675778594656Writing region info on filesystem at 1675778594656Initializing all the Stores at 1675778594656Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594657 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594658 (+1 ms)Cleaning up temporary data from old regions at 1675778594665 (+7 ms)Cleaning up detritus from prior splits at 1675778594666 (+1 ms)Running coprocessor post-open hooks at 1675778594669 (+3 ms)Region opened successfully at 1675778594669 2023-02-07 14:03:14,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b., pid=25, masterSystemTime=1675778594574 2023-02-07 14:03:14,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:14,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:14,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bc79e3a18b31e18d3202857c81987c1c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72329572, jitterRate=0.07779461145401001}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:14,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:14,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bc79e3a18b31e18d3202857c81987c1c: Running coprocessor pre-open hook at 1675778594657Writing region info on filesystem at 1675778594657Initializing all the Stores at 1675778594658 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594658Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778594658Cleaning up temporary data from old regions at 1675778594668 (+10 ms)Cleaning up detritus from prior splits at 1675778594668Running coprocessor post-open hooks at 1675778594672 (+4 ms)Region opened successfully at 1675778594672 2023-02-07 14:03:14,672 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=8cac1335a37cfd271778dece578dc88b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:14,672 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594672"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778594672"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778594672"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778594672"}]},"ts":"1675778594672"} 2023-02-07 14:03:14,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c., pid=29, masterSystemTime=1675778594580 2023-02-07 14:03:14,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:14,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:14,674 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=bc79e3a18b31e18d3202857c81987c1c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:14,674 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778594674"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778594674"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778594674"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778594674"}]},"ts":"1675778594674"} 2023-02-07 14:03:14,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-07 14:03:14,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure 8cac1335a37cfd271778dece578dc88b, server=jenkins-hbase4.apache.org,45365,1675778592875 in 246 msec 2023-02-07 14:03:14,676 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8cac1335a37cfd271778dece578dc88b, ASSIGN in 415 msec 2023-02-07 14:03:14,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-07 14:03:14,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure bc79e3a18b31e18d3202857c81987c1c, server=jenkins-hbase4.apache.org,44239,1675778592805 in 241 msec 2023-02-07 14:03:14,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=10 2023-02-07 14:03:14,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc79e3a18b31e18d3202857c81987c1c, ASSIGN in 416 msec 2023-02-07 14:03:14,678 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:03:14,678 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778594678"}]},"ts":"1675778594678"} 2023-02-07 14:03:14,680 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-07 14:03:14,681 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:03:14,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 558 msec 2023-02-07 14:03:14,736 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:14,736 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:14,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:14,738 INFO [Listener at localhost/45865] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-07 14:03:14,738 DEBUG [Listener at localhost/45865] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-07 14:03:14,738 INFO [Listener at localhost/45865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:03:14,740 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-07 14:03:14,741 INFO [Listener at localhost/45865] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:03:14,741 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-07 14:03:14,741 INFO [Listener at localhost/45865] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 14:03:14,773 DEBUG [hconnection-0x593c54d0-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:14,784 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44239] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:14,788 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58860, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:14,796 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45365] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:14,863 INFO [Listener at localhost/45865] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 14:03:14,863 INFO [Listener at localhost/45865] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 14:03:14,863 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:14,863 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:14,864 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-07 14:03:14,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675778594864 (current time:1675778594864). 2023-02-07 14:03:14,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 14:03:14,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] zookeeper.ReadOnlyZKClient(139): Connect 0x6deaf69a to 127.0.0.1:61542 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:14,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d8a1b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:14,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:14,938 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47092, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:14,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6deaf69a to 127.0.0.1:61542 2023-02-07 14:03:14,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:14,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 14:03:14,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-07 14:03:14,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-07 14:03:14,943 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-07 14:03:14,943 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675779194943 2023-02-07 14:03:14,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-07 14:03:14,944 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-07 14:03:14,945 DEBUG [Listener at localhost/45865] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 14:03:14,945 DEBUG [Listener at localhost/45865] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 14:03:14,945 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-07 14:03:14,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-07 14:03:14,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 5 msec 2023-02-07 14:03:14,947 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-07 14:03:14,947 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1675779194947 2023-02-07 14:03:14,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-07 14:03:14,956 INFO [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-07 14:03:14,956 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:14,957 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-07 14:03:14,957 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-07 14:03:14,974 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:14,974 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,004 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:15,004 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,004 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:15,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:15,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:15,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:15,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:15,005 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,005 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,005 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,005 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:03:15,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-07 14:03:15,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,006 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-07 14:03:15,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-07 14:03:15,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,006 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-07 14:03:15,006 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,006 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,006 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-07 14:03:15,006 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:15,009 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 14:03:15,009 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-07 14:03:15,009 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44239,1675778592805' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-07 14:03:15,009 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-07 14:03:15,009 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:15,009 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 14:03:15,009 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-07 14:03:15,009 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45365,1675778592875' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-07 14:03:15,046 DEBUG [Listener at localhost/45865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:15,046 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:15,046 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:15,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-07 14:03:15,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:03:15,047 DEBUG [Listener at localhost/45865] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 14:03:15,066 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,066 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:15,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:15,143 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:15,143 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,143 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,143 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:15,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:15,144 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,144 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:15,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:15,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44239,1675778592805' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-07 14:03:15,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a2f6a1c[Count = 1] remaining members to acquire global barrier 2023-02-07 14:03:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:15,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45365,1675778592875' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-07 14:03:15,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a2f6a1c[Count = 0] remaining members to acquire global barrier 2023-02-07 14:03:15,147 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-07 14:03:15,147 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,166 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,166 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,166 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,166 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 14:03:15,166 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 14:03:15,167 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:15,167 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:15,167 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. started... 2023-02-07 14:03:15,167 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. started... 2023-02-07 14:03:15,167 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:15,167 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,168 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:15,168 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:03:15,168 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:15,168 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HRegion(2744): Flushing bc79e3a18b31e18d3202857c81987c1c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:03:15,168 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7b537e9af0f831a97df0ff3a15af9fe4: 2023-02-07 14:03:15,168 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 14:03:15,168 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 14:03:15,167 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. started... 2023-02-07 14:03:15,168 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,168 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:15,169 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:15,167 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-07 14:03:15,169 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 14:03:15,169 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 14:03:15,169 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 56002cf8b83f4276529438d13b773bb8 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:03:15,169 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. started... 2023-02-07 14:03:15,168 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. started... 2023-02-07 14:03:15,168 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. started... 2023-02-07 14:03:15,170 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 817b819a97bae6e7ccdc3339bba18bec: 2023-02-07 14:03:15,169 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 14:03:15,171 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,171 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 6a24f898703d5e53fde0a818f5deba08 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:03:15,171 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:15,171 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 14:03:15,172 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-07 14:03:15,172 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] regionserver.HRegion(2744): Flushing cd032384c7aae39dc559f0ab4870f85a 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:03:15,192 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. completed. 2023-02-07 14:03:15,193 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:15,193 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:15,193 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. started... 2023-02-07 14:03:15,193 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 14:03:15,201 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/.tmp/f1/b3cd015900374c20adaa588e1d9906e2 2023-02-07 14:03:15,203 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 1480baf3a921359925457313a52e67f8 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 14:03:15,209 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/.tmp/f1/19042036c746481fb4464227e5fbac07 2023-02-07 14:03:15,210 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/.tmp/f1/7907380e90f541cca95857ccbc76e75c 2023-02-07 14:03:15,231 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/.tmp/f2/0716f7217e64439f8a49dc7a2dd96e22 2023-02-07 14:03:15,237 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/.tmp/f1/b3cd015900374c20adaa588e1d9906e2 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1/b3cd015900374c20adaa588e1d9906e2 2023-02-07 14:03:15,240 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/.tmp/f1/052498e3e71b499fa32e97117a16cb76 2023-02-07 14:03:15,242 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1/b3cd015900374c20adaa588e1d9906e2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:15,248 DEBUG [Listener at localhost/45865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:15,248 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:15,248 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:15,250 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/.tmp/f2/0716f7217e64439f8a49dc7a2dd96e22 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2/0716f7217e64439f8a49dc7a2dd96e22 2023-02-07 14:03:15,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-07 14:03:15,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:03:15,251 DEBUG [Listener at localhost/45865] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-07 14:03:15,256 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2/0716f7217e64439f8a49dc7a2dd96e22, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:15,256 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6a24f898703d5e53fde0a818f5deba08 in 85ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:15,257 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-07 14:03:15,257 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 6a24f898703d5e53fde0a818f5deba08: 2023-02-07 14:03:15,257 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,261 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:15,261 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1/b3cd015900374c20adaa588e1d9906e2] hfiles 2023-02-07 14:03:15,261 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1/b3cd015900374c20adaa588e1d9906e2 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,261 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/.tmp/f2/b12d2a47ba864732810a6f73d52468d3 2023-02-07 14:03:15,261 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2/0716f7217e64439f8a49dc7a2dd96e22] hfiles 2023-02-07 14:03:15,261 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2/0716f7217e64439f8a49dc7a2dd96e22 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,272 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/.tmp/f2/88111b54bbdf4212a651b743d690da07 2023-02-07 14:03:15,273 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/.tmp/f1/19042036c746481fb4464227e5fbac07 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1/19042036c746481fb4464227e5fbac07 2023-02-07 14:03:15,276 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/.tmp/f1/7907380e90f541cca95857ccbc76e75c as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1/7907380e90f541cca95857ccbc76e75c 2023-02-07 14:03:15,281 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1/7907380e90f541cca95857ccbc76e75c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:15,281 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/.tmp/f2/88111b54bbdf4212a651b743d690da07 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2/88111b54bbdf4212a651b743d690da07 2023-02-07 14:03:15,287 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2/88111b54bbdf4212a651b743d690da07, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:15,287 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1/19042036c746481fb4464227e5fbac07, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:15,288 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 56002cf8b83f4276529438d13b773bb8 in 119ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:15,288 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/.tmp/f2/fc061ce0980f4017b9b281f3ed4aeb0a 2023-02-07 14:03:15,289 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 56002cf8b83f4276529438d13b773bb8: 2023-02-07 14:03:15,289 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,289 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:15,289 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1/7907380e90f541cca95857ccbc76e75c] hfiles 2023-02-07 14:03:15,289 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1/7907380e90f541cca95857ccbc76e75c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,290 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2/88111b54bbdf4212a651b743d690da07] hfiles 2023-02-07 14:03:15,290 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2/88111b54bbdf4212a651b743d690da07 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,290 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/.tmp/f2/b12d2a47ba864732810a6f73d52468d3 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2/b12d2a47ba864732810a6f73d52468d3 2023-02-07 14:03:15,290 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. completed. 2023-02-07 14:03:15,290 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:15,290 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:15,290 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. started... 2023-02-07 14:03:15,290 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-07 14:03:15,291 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 8db3168d240af3f198f5e5aee2b07fe8 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-07 14:03:15,296 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2/b12d2a47ba864732810a6f73d52468d3, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:15,296 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/.tmp/f1/052498e3e71b499fa32e97117a16cb76 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1/052498e3e71b499fa32e97117a16cb76 2023-02-07 14:03:15,298 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bc79e3a18b31e18d3202857c81987c1c in 130ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:15,298 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for bc79e3a18b31e18d3202857c81987c1c: 2023-02-07 14:03:15,298 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,298 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:15,298 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1/19042036c746481fb4464227e5fbac07] hfiles 2023-02-07 14:03:15,299 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1/19042036c746481fb4464227e5fbac07 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,299 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2/b12d2a47ba864732810a6f73d52468d3] hfiles 2023-02-07 14:03:15,299 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2/b12d2a47ba864732810a6f73d52468d3 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,305 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. completed. 2023-02-07 14:03:15,305 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:15,305 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:15,305 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 14:03:15,305 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. started... 2023-02-07 14:03:15,310 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 8cac1335a37cfd271778dece578dc88b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:03:15,313 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1/052498e3e71b499fa32e97117a16cb76, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 14:03:15,313 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/.tmp/f1/498c8183851f415aade9b9588d9be131 2023-02-07 14:03:15,314 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/.tmp/f2/fc061ce0980f4017b9b281f3ed4aeb0a as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2/fc061ce0980f4017b9b281f3ed4aeb0a 2023-02-07 14:03:15,318 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. completed. 2023-02-07 14:03:15,318 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:15,318 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:15,318 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-07 14:03:15,318 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. started... 2023-02-07 14:03:15,319 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3d27aaddb20d932428863d8eda2399b2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-07 14:03:15,321 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2/fc061ce0980f4017b9b281f3ed4aeb0a, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 14:03:15,322 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 1480baf3a921359925457313a52e67f8 in 119ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:15,322 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 1480baf3a921359925457313a52e67f8: 2023-02-07 14:03:15,322 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,322 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:15,322 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1/052498e3e71b499fa32e97117a16cb76] hfiles 2023-02-07 14:03:15,322 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1/052498e3e71b499fa32e97117a16cb76 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,322 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2/fc061ce0980f4017b9b281f3ed4aeb0a] hfiles 2023-02-07 14:03:15,322 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2/fc061ce0980f4017b9b281f3ed4aeb0a for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,336 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. completed. 2023-02-07 14:03:15,336 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:15,336 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 14:03:15,343 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/.tmp/f1/ab25ce00594a49cf9390c9116c456877 2023-02-07 14:03:15,343 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/.tmp/f2/114841eba3da43d0835af7edc37a3434 2023-02-07 14:03:15,348 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/.tmp/f1/498c8183851f415aade9b9588d9be131 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1/498c8183851f415aade9b9588d9be131 2023-02-07 14:03:15,353 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1/498c8183851f415aade9b9588d9be131, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 14:03:15,353 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/.tmp/f2/114841eba3da43d0835af7edc37a3434 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2/114841eba3da43d0835af7edc37a3434 2023-02-07 14:03:15,358 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2/114841eba3da43d0835af7edc37a3434, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-07 14:03:15,359 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 8db3168d240af3f198f5e5aee2b07fe8 in 68ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:15,359 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 8db3168d240af3f198f5e5aee2b07fe8: 2023-02-07 14:03:15,359 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,359 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:15,359 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1/498c8183851f415aade9b9588d9be131] hfiles 2023-02-07 14:03:15,359 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1/498c8183851f415aade9b9588d9be131 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,359 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2/114841eba3da43d0835af7edc37a3434] hfiles 2023-02-07 14:03:15,359 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2/114841eba3da43d0835af7edc37a3434 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,382 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/.tmp/f2/25ac6bea21c84f01b1c1a8d2585e60fb 2023-02-07 14:03:15,388 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/.tmp/f1/ab25ce00594a49cf9390c9116c456877 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1/ab25ce00594a49cf9390c9116c456877 2023-02-07 14:03:15,393 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1/ab25ce00594a49cf9390c9116c456877, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:15,396 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/.tmp/f2/25ac6bea21c84f01b1c1a8d2585e60fb as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2/25ac6bea21c84f01b1c1a8d2585e60fb 2023-02-07 14:03:15,401 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2/25ac6bea21c84f01b1c1a8d2585e60fb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:15,402 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3d27aaddb20d932428863d8eda2399b2 in 83ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:15,402 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3d27aaddb20d932428863d8eda2399b2: 2023-02-07 14:03:15,402 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,402 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:15,402 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1/ab25ce00594a49cf9390c9116c456877] hfiles 2023-02-07 14:03:15,402 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1/ab25ce00594a49cf9390c9116c456877 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,402 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2/25ac6bea21c84f01b1c1a8d2585e60fb] hfiles 2023-02-07 14:03:15,402 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2/25ac6bea21c84f01b1c1a8d2585e60fb for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,412 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. completed. 2023-02-07 14:03:15,412 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:15,412 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 14:03:15,551 DEBUG [Listener at localhost/45865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:15,551 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:15,551 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:15,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-07 14:03:15,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:03:15,553 DEBUG [Listener at localhost/45865] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-07 14:03:15,597 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. completed. 2023-02-07 14:03:15,597 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:15,597 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 14:03:15,597 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 14:03:15,597 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,597 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-07 14:03:15,598 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,44239,1675778592805' in zk 2023-02-07 14:03:15,608 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/.tmp/f1/569d1779835b4c6f9e623e7507ff742b 2023-02-07 14:03:15,623 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/.tmp/f2/85fe7fe2f7314b77a7a1cc92507e7458 2023-02-07 14:03:15,627 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/.tmp/f1/569d1779835b4c6f9e623e7507ff742b as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1/569d1779835b4c6f9e623e7507ff742b 2023-02-07 14:03:15,631 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1/569d1779835b4c6f9e623e7507ff742b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:15,632 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/.tmp/f2/85fe7fe2f7314b77a7a1cc92507e7458 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2/85fe7fe2f7314b77a7a1cc92507e7458 2023-02-07 14:03:15,637 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2/85fe7fe2f7314b77a7a1cc92507e7458, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:15,638 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for cd032384c7aae39dc559f0ab4870f85a in 466ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:15,638 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for cd032384c7aae39dc559f0ab4870f85a: 2023-02-07 14:03:15,639 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,639 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:15,639 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1/569d1779835b4c6f9e623e7507ff742b] hfiles 2023-02-07 14:03:15,639 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1/569d1779835b4c6f9e623e7507ff742b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,639 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2/85fe7fe2f7314b77a7a1cc92507e7458] hfiles 2023-02-07 14:03:15,639 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2/85fe7fe2f7314b77a7a1cc92507e7458 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,643 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-07 14:03:15,643 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,643 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:15,643 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-07 14:03:15,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:15,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:15,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:15,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,646 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. completed. 2023-02-07 14:03:15,646 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:15,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,646 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-07 14:03:15,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,44239,1675778592805': 2023-02-07 14:03:15,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44239,1675778592805' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-07 14:03:15,728 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/.tmp/f1/355d547fbbd9448a969e9ab91bbbd1cd 2023-02-07 14:03:15,743 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/.tmp/f2/a0651377e9004ed99e6ad20d5723e839 2023-02-07 14:03:15,747 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/.tmp/f1/355d547fbbd9448a969e9ab91bbbd1cd as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1/355d547fbbd9448a969e9ab91bbbd1cd 2023-02-07 14:03:15,750 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1/355d547fbbd9448a969e9ab91bbbd1cd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:15,751 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/.tmp/f2/a0651377e9004ed99e6ad20d5723e839 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2/a0651377e9004ed99e6ad20d5723e839 2023-02-07 14:03:15,754 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2/a0651377e9004ed99e6ad20d5723e839, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-07 14:03:15,755 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8cac1335a37cfd271778dece578dc88b in 445ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:15,755 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8cac1335a37cfd271778dece578dc88b: 2023-02-07 14:03:15,755 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,755 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:15,755 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1/355d547fbbd9448a969e9ab91bbbd1cd] hfiles 2023-02-07 14:03:15,755 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1/355d547fbbd9448a969e9ab91bbbd1cd for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,755 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2/a0651377e9004ed99e6ad20d5723e839] hfiles 2023-02-07 14:03:15,755 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2/a0651377e9004ed99e6ad20d5723e839 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,761 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. completed. 2023-02-07 14:03:15,761 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:15,761 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-07 14:03:15,783 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. completed. 2023-02-07 14:03:15,783 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:15,783 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-07 14:03:15,783 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-07 14:03:15,783 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,783 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-07 14:03:15,783 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,45365,1675778592875' in zk 2023-02-07 14:03:15,784 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-07 14:03:15,784 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,784 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:15,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:15,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:15,784 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-07 14:03:15,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:15,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:15,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,45365,1675778592875': 2023-02-07 14:03:15,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45365,1675778592875' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-07 14:03:15,788 INFO [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-07 14:03:15,788 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:03:15,788 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:03:15,788 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,788 INFO [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 14:03:15,790 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,790 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:15,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:15,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,790 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:15,790 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,790 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:15,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:15,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:15,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:15,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:15,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:15,791 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,791 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:15,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,792 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:15,793 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,802 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,802 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,802 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:15,802 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,802 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:15,803 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:15,803 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:15,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:15,803 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,803 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:15,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:15,803 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:15,803 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:15,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:15,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:15,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:15,803 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,803 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:15,803 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,803 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:15,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:15,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-07 14:03:15,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,858 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:15,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1675778594944Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1675778595803 (+859 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1675778595803Writing data manifest for testWithMockedMapReduceMultiRegion at 1675778595813 (+10 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1675778595824 (+11 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1675778595858 (+34 ms) 2023-02-07 14:03:15,860 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-07 14:03:15,861 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 915 msec 2023-02-07 14:03:16,053 DEBUG [Listener at localhost/45865] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:16,054 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:16,054 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:16,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-07 14:03:16,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 14:03:16,055 INFO [Listener at localhost/45865] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 14:03:16,055 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:16,055 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:16,059 INFO [Listener at localhost/45865] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 14:03:16,065 INFO [Listener at localhost/45865] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 14:03:16,083 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44239] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:16,090 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45365] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:16,152 INFO [Listener at localhost/45865] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 14:03:16,155 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:16,155 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:16,159 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 14:03:16,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,161 INFO [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-07 14:03:16,161 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:16,162 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-07 14:03:16,162 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-07 14:03:16,162 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,162 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,163 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:16,163 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:16,163 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:16,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:16,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:16,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:16,164 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,164 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,164 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,164 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:03:16,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:03:16,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,165 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,165 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,165 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-07 14:03:16,165 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:16,166 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 14:03:16,166 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:16,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,166 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. started... 2023-02-07 14:03:16,166 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:16,166 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. started... 2023-02-07 14:03:16,166 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 56002cf8b83f4276529438d13b773bb8 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:03:16,166 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 14:03:16,167 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cd032384c7aae39dc559f0ab4870f85a 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:03:16,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:03:16,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,167 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 14:03:16,167 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:16,167 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,167 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. started... 2023-02-07 14:03:16,167 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 6a24f898703d5e53fde0a818f5deba08 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:03:16,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,168 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-07 14:03:16,168 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:16,169 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-07 14:03:16,169 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:16,169 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. started... 2023-02-07 14:03:16,169 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:16,171 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. started... 2023-02-07 14:03:16,171 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:16,171 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bc79e3a18b31e18d3202857c81987c1c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:03:16,171 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b537e9af0f831a97df0ff3a15af9fe4: 2023-02-07 14:03:16,171 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:16,171 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:16,171 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. started... 2023-02-07 14:03:16,171 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1480baf3a921359925457313a52e67f8 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 14:03:16,169 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-07 14:03:16,171 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 14:03:16,172 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 14:03:16,171 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. started... 2023-02-07 14:03:16,172 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 817b819a97bae6e7ccdc3339bba18bec: 2023-02-07 14:03:16,173 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:16,173 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:16,173 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. started... 2023-02-07 14:03:16,173 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3d27aaddb20d932428863d8eda2399b2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:03:16,174 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 14:03:16,208 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/.tmp/f1/0b60d700e3f342f88aa4f9d4470a0680 2023-02-07 14:03:16,209 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/.tmp/f1/0b92aed332ea4c3d9d9e5fefe1d2d8b1 2023-02-07 14:03:16,209 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/.tmp/f1/0180c48b5e7348b7b43960cb8551318e 2023-02-07 14:03:16,220 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/.tmp/f1/79a7e5dcbc2a4cfc9b78a4d642931ac1 2023-02-07 14:03:16,228 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/.tmp/f1/337d45cab4d847809272fba5fed7e72a 2023-02-07 14:03:16,250 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/.tmp/f1/bab78cba95f5459d9649b1057cd8b5dc 2023-02-07 14:03:16,251 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/.tmp/f2/82f167ac51414bd0aee6fc7f2cfba268 2023-02-07 14:03:16,257 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/.tmp/f1/0180c48b5e7348b7b43960cb8551318e as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1/0180c48b5e7348b7b43960cb8551318e 2023-02-07 14:03:16,267 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1/0180c48b5e7348b7b43960cb8551318e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:16,270 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/.tmp/f2/82f167ac51414bd0aee6fc7f2cfba268 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2/82f167ac51414bd0aee6fc7f2cfba268 2023-02-07 14:03:16,278 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2/82f167ac51414bd0aee6fc7f2cfba268, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:16,278 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/.tmp/f2/2f35e7a04f2f41a59d69429a8833dbae 2023-02-07 14:03:16,279 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 56002cf8b83f4276529438d13b773bb8 in 113ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:16,279 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 56002cf8b83f4276529438d13b773bb8: 2023-02-07 14:03:16,279 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:16,279 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:16,279 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. started... 2023-02-07 14:03:16,279 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-07 14:03:16,280 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8db3168d240af3f198f5e5aee2b07fe8 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-07 14:03:16,284 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/.tmp/f1/79a7e5dcbc2a4cfc9b78a4d642931ac1 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1/79a7e5dcbc2a4cfc9b78a4d642931ac1 2023-02-07 14:03:16,287 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1/79a7e5dcbc2a4cfc9b78a4d642931ac1, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 14:03:16,289 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/.tmp/f2/564daf0b367f4fd096760ecf174bfb66 2023-02-07 14:03:16,289 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/.tmp/f2/6ee3ca2266ee44a8bf573fde5e4e2ad8 2023-02-07 14:03:16,290 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/.tmp/f2/2f35e7a04f2f41a59d69429a8833dbae as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2/2f35e7a04f2f41a59d69429a8833dbae 2023-02-07 14:03:16,293 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/.tmp/f2/c8fc48ad53b1452e836a1d0c5ea1006f 2023-02-07 14:03:16,294 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/.tmp/f1/337d45cab4d847809272fba5fed7e72a as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1/337d45cab4d847809272fba5fed7e72a 2023-02-07 14:03:16,295 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/.tmp/f2/f5b142508bcc43a19f61b7e3feb1b49d 2023-02-07 14:03:16,295 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/.tmp/f1/0b92aed332ea4c3d9d9e5fefe1d2d8b1 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1/0b92aed332ea4c3d9d9e5fefe1d2d8b1 2023-02-07 14:03:16,299 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2/2f35e7a04f2f41a59d69429a8833dbae, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 14:03:16,300 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 1480baf3a921359925457313a52e67f8 in 129ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:16,300 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1480baf3a921359925457313a52e67f8: 2023-02-07 14:03:16,300 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:16,300 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 14:03:16,300 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/.tmp/f1/0b60d700e3f342f88aa4f9d4470a0680 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1/0b60d700e3f342f88aa4f9d4470a0680 2023-02-07 14:03:16,301 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/.tmp/f1/bab78cba95f5459d9649b1057cd8b5dc as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1/bab78cba95f5459d9649b1057cd8b5dc 2023-02-07 14:03:16,301 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1/337d45cab4d847809272fba5fed7e72a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:16,302 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1/0b92aed332ea4c3d9d9e5fefe1d2d8b1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:16,302 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/.tmp/f2/564daf0b367f4fd096760ecf174bfb66 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2/564daf0b367f4fd096760ecf174bfb66 2023-02-07 14:03:16,303 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/.tmp/f1/9f9033ba05ac4e19806e5ebd7b369e11 2023-02-07 14:03:16,303 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/.tmp/f2/6ee3ca2266ee44a8bf573fde5e4e2ad8 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2/6ee3ca2266ee44a8bf573fde5e4e2ad8 2023-02-07 14:03:16,306 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1/bab78cba95f5459d9649b1057cd8b5dc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:16,307 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1/0b60d700e3f342f88aa4f9d4470a0680, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:16,307 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/.tmp/f2/f5b142508bcc43a19f61b7e3feb1b49d as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2/f5b142508bcc43a19f61b7e3feb1b49d 2023-02-07 14:03:16,308 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/.tmp/f2/c8fc48ad53b1452e836a1d0c5ea1006f as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2/c8fc48ad53b1452e836a1d0c5ea1006f 2023-02-07 14:03:16,308 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2/6ee3ca2266ee44a8bf573fde5e4e2ad8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:16,308 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2/564daf0b367f4fd096760ecf174bfb66, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:16,309 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for cd032384c7aae39dc559f0ab4870f85a in 142ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:16,309 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cd032384c7aae39dc559f0ab4870f85a: 2023-02-07 14:03:16,309 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:16,309 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:16,309 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6a24f898703d5e53fde0a818f5deba08 in 142ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:16,309 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-07 14:03:16,309 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 6a24f898703d5e53fde0a818f5deba08: 2023-02-07 14:03:16,309 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. started... 2023-02-07 14:03:16,309 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:16,309 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-07 14:03:16,309 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 8cac1335a37cfd271778dece578dc88b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-07 14:03:16,319 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2/f5b142508bcc43a19f61b7e3feb1b49d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:16,319 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2/c8fc48ad53b1452e836a1d0c5ea1006f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:16,320 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3d27aaddb20d932428863d8eda2399b2 in 147ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:16,320 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3d27aaddb20d932428863d8eda2399b2: 2023-02-07 14:03:16,320 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:16,320 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 14:03:16,321 INFO [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bc79e3a18b31e18d3202857c81987c1c in 150ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:16,321 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bc79e3a18b31e18d3202857c81987c1c: 2023-02-07 14:03:16,321 DEBUG [rs(jenkins-hbase4.apache.org,44239,1675778592805)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:16,321 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 14:03:16,321 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 14:03:16,321 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,324 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-07 14:03:16,324 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44239,1675778592805' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-07 14:03:16,326 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,326 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:16,326 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,326 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:16,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:16,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44239,1675778592805' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-07 14:03:16,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e10e181[Count = 1] remaining members to acquire global barrier 2023-02-07 14:03:16,328 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/.tmp/f2/d4756733f56b4c53950e9e1092aac232 2023-02-07 14:03:16,333 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/.tmp/f1/9f9033ba05ac4e19806e5ebd7b369e11 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1/9f9033ba05ac4e19806e5ebd7b369e11 2023-02-07 14:03:16,337 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1/9f9033ba05ac4e19806e5ebd7b369e11, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 14:03:16,337 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/.tmp/f2/d4756733f56b4c53950e9e1092aac232 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2/d4756733f56b4c53950e9e1092aac232 2023-02-07 14:03:16,344 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/.tmp/f1/8ff2fc2a618c41fe8a4a7bd7e129b073 2023-02-07 14:03:16,345 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2/d4756733f56b4c53950e9e1092aac232, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-07 14:03:16,346 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 8db3168d240af3f198f5e5aee2b07fe8 in 67ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:16,346 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8db3168d240af3f198f5e5aee2b07fe8: 2023-02-07 14:03:16,346 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:16,346 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-07 14:03:16,362 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/.tmp/f2/688869d1b8d849d99f790bcf2e28d4c8 2023-02-07 14:03:16,367 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/.tmp/f1/8ff2fc2a618c41fe8a4a7bd7e129b073 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1/8ff2fc2a618c41fe8a4a7bd7e129b073 2023-02-07 14:03:16,370 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1/8ff2fc2a618c41fe8a4a7bd7e129b073, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:16,371 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/.tmp/f2/688869d1b8d849d99f790bcf2e28d4c8 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2/688869d1b8d849d99f790bcf2e28d4c8 2023-02-07 14:03:16,374 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2/688869d1b8d849d99f790bcf2e28d4c8, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-07 14:03:16,375 INFO [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8cac1335a37cfd271778dece578dc88b in 66ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:16,375 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8cac1335a37cfd271778dece578dc88b: 2023-02-07 14:03:16,375 DEBUG [rs(jenkins-hbase4.apache.org,45365,1675778592875)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:16,375 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-07 14:03:16,375 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-07 14:03:16,375 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,375 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-07 14:03:16,376 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45365,1675778592875' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-07 14:03:16,379 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,379 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:16,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:16,379 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,379 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:16,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:16,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:16,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:16,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45365,1675778592875' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-07 14:03:16,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e10e181[Count = 0] remaining members to acquire global barrier 2023-02-07 14:03:16,381 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-07 14:03:16,381 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,382 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,382 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,382 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 14:03:16,382 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,382 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-07 14:03:16,382 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,44239,1675778592805' in zk 2023-02-07 14:03:16,382 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-07 14:03:16,382 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-07 14:03:16,382 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,45365,1675778592875' in zk 2023-02-07 14:03:16,382 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,382 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:03:16,384 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-07 14:03:16,384 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,384 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-07 14:03:16,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:16,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:16,384 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:16,384 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,384 DEBUG [member: 'jenkins-hbase4.apache.org,45365,1675778592875' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-07 14:03:16,384 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:16,384 DEBUG [member: 'jenkins-hbase4.apache.org,44239,1675778592805' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-07 14:03:16,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:16,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:16,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:16,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,44239,1675778592805': 2023-02-07 14:03:16,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44239,1675778592805' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-07 14:03:16,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:16,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:16,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:16,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:16,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:16,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,45365,1675778592875': 2023-02-07 14:03:16,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45365,1675778592875' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-07 14:03:16,389 INFO [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-07 14:03:16,389 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:03:16,389 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:03:16,389 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,389 INFO [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 14:03:16,390 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,390 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,390 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:16,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:16,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:16,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,390 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,391 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:16,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:16,391 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:16,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:16,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:16,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:16,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,391 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:16,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:16,393 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,393 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,397 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,397 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,397 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,397 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:16,397 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,397 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:16,397 DEBUG [(jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:16,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:16,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:16,397 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:16,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:16,397 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:16,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:16,397 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,397 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:16,397 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-07 14:03:16,398 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 14:03:16,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:16,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:16,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:16,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:16,397 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:16,398 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,398 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,398 DEBUG [Listener at localhost/45865] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-07 14:03:16,398 DEBUG [Listener at localhost/45865] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 14:03:16,498 DEBUG [Listener at localhost/45865] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 14:03:16,498 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:16,498 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:16,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 14:03:16,504 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675778594864 type: FLUSH version: 2 ttl: 0 2023-02-07 14:03:16,504 DEBUG [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,504 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(239): region to add: 7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(239): region to add: bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(239): region to add: 817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(239): region to add: 56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(239): region to add: cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(239): region to add: 6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(239): region to add: 1480baf3a921359925457313a52e67f8 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(239): region to add: 8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(239): region to add: 8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(239): region to add: 3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(585): clone region=7b537e9af0f831a97df0ff3a15af9fe4 as 7b537e9af0f831a97df0ff3a15af9fe4 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(585): clone region=bc79e3a18b31e18d3202857c81987c1c as bc79e3a18b31e18d3202857c81987c1c in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(585): clone region=817b819a97bae6e7ccdc3339bba18bec as 817b819a97bae6e7ccdc3339bba18bec in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(585): clone region=56002cf8b83f4276529438d13b773bb8 as 56002cf8b83f4276529438d13b773bb8 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(585): clone region=cd032384c7aae39dc559f0ab4870f85a as cd032384c7aae39dc559f0ab4870f85a in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(585): clone region=6a24f898703d5e53fde0a818f5deba08 as 6a24f898703d5e53fde0a818f5deba08 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(585): clone region=1480baf3a921359925457313a52e67f8 as 1480baf3a921359925457313a52e67f8 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(585): clone region=8db3168d240af3f198f5e5aee2b07fe8 as 8db3168d240af3f198f5e5aee2b07fe8 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(585): clone region=8cac1335a37cfd271778dece578dc88b as 8cac1335a37cfd271778dece578dc88b in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,505 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(585): clone region=3d27aaddb20d932428863d8eda2399b2 as 3d27aaddb20d932428863d8eda2399b2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,507 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => cd032384c7aae39dc559f0ab4870f85a, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d 2023-02-07 14:03:16,507 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 8db3168d240af3f198f5e5aee2b07fe8, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d 2023-02-07 14:03:16,507 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 1480baf3a921359925457313a52e67f8, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d 2023-02-07 14:03:16,507 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7b537e9af0f831a97df0ff3a15af9fe4, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d 2023-02-07 14:03:16,507 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 6a24f898703d5e53fde0a818f5deba08, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d 2023-02-07 14:03:16,507 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 56002cf8b83f4276529438d13b773bb8, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d 2023-02-07 14:03:16,508 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 817b819a97bae6e7ccdc3339bba18bec, NAME => 'testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d 2023-02-07 14:03:16,508 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => bc79e3a18b31e18d3202857c81987c1c, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d 2023-02-07 14:03:16,548 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:16,548 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 498c8183851f415aade9b9588d9be131 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,556 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:16,557 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 817b819a97bae6e7ccdc3339bba18bec, disabling compactions & flushes 2023-02-07 14:03:16,557 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:16,557 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:16,557 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. after waiting 0 ms 2023-02-07 14:03:16,557 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:16,557 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:16,557 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 817b819a97bae6e7ccdc3339bba18bec: Waiting for close lock at 1675778596557Disabling compacts and flushes for region at 1675778596557Disabling writes for close at 1675778596557Writing region close event to WAL at 1675778596557Closed at 1675778596557 2023-02-07 14:03:16,557 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 8cac1335a37cfd271778dece578dc88b, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d 2023-02-07 14:03:16,560 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:16,560 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 052498e3e71b499fa32e97117a16cb76 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,567 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:16,567 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 19042036c746481fb4464227e5fbac07 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,568 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 114841eba3da43d0835af7edc37a3434 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,568 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:16,569 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b3cd015900374c20adaa588e1d9906e2 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,569 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:16,569 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:16,569 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 569d1779835b4c6f9e623e7507ff742b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,569 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7907380e90f541cca95857ccbc76e75c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,570 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:16,570 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 7b537e9af0f831a97df0ff3a15af9fe4, disabling compactions & flushes 2023-02-07 14:03:16,570 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:16,570 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:16,570 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. after waiting 0 ms 2023-02-07 14:03:16,570 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:16,570 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:16,570 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 7b537e9af0f831a97df0ff3a15af9fe4: Waiting for close lock at 1675778596570Disabling compacts and flushes for region at 1675778596570Disabling writes for close at 1675778596570Writing region close event to WAL at 1675778596570Closed at 1675778596570 2023-02-07 14:03:16,571 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3d27aaddb20d932428863d8eda2399b2, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d 2023-02-07 14:03:16,576 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fc061ce0980f4017b9b281f3ed4aeb0a from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,585 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0716f7217e64439f8a49dc7a2dd96e22 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,585 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 8db3168d240af3f198f5e5aee2b07fe8, disabling compactions & flushes 2023-02-07 14:03:16,585 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:16,585 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:16,585 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. after waiting 0 ms 2023-02-07 14:03:16,585 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:16,585 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:16,585 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 8db3168d240af3f198f5e5aee2b07fe8: Waiting for close lock at 1675778596585Disabling compacts and flushes for region at 1675778596585Disabling writes for close at 1675778596585Writing region close event to WAL at 1675778596585Closed at 1675778596585 2023-02-07 14:03:16,585 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 88111b54bbdf4212a651b743d690da07 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,585 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 85fe7fe2f7314b77a7a1cc92507e7458 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,588 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 1480baf3a921359925457313a52e67f8, disabling compactions & flushes 2023-02-07 14:03:16,588 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:16,588 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 355d547fbbd9448a969e9ab91bbbd1cd from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,588 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:16,588 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:16,589 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b12d2a47ba864732810a6f73d52468d3 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,589 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. after waiting 0 ms 2023-02-07 14:03:16,589 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:16,589 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:16,589 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 6a24f898703d5e53fde0a818f5deba08, disabling compactions & flushes 2023-02-07 14:03:16,589 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 1480baf3a921359925457313a52e67f8: Waiting for close lock at 1675778596588Disabling compacts and flushes for region at 1675778596588Disabling writes for close at 1675778596589 (+1 ms)Writing region close event to WAL at 1675778596589Closed at 1675778596589 2023-02-07 14:03:16,589 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:16,589 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:16,589 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. after waiting 0 ms 2023-02-07 14:03:16,589 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:16,589 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:16,589 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 6a24f898703d5e53fde0a818f5deba08: Waiting for close lock at 1675778596589Disabling compacts and flushes for region at 1675778596589Disabling writes for close at 1675778596589Writing region close event to WAL at 1675778596589Closed at 1675778596589 2023-02-07 14:03:16,593 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 56002cf8b83f4276529438d13b773bb8, disabling compactions & flushes 2023-02-07 14:03:16,593 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing cd032384c7aae39dc559f0ab4870f85a, disabling compactions & flushes 2023-02-07 14:03:16,593 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:16,593 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:16,593 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:16,593 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:16,593 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. after waiting 0 ms 2023-02-07 14:03:16,593 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. after waiting 0 ms 2023-02-07 14:03:16,593 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a0651377e9004ed99e6ad20d5723e839 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,593 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:16,593 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:16,593 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:16,593 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:16,593 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 56002cf8b83f4276529438d13b773bb8: Waiting for close lock at 1675778596593Disabling compacts and flushes for region at 1675778596593Disabling writes for close at 1675778596593Writing region close event to WAL at 1675778596593Closed at 1675778596593 2023-02-07 14:03:16,593 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing bc79e3a18b31e18d3202857c81987c1c, disabling compactions & flushes 2023-02-07 14:03:16,593 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for cd032384c7aae39dc559f0ab4870f85a: Waiting for close lock at 1675778596593Disabling compacts and flushes for region at 1675778596593Disabling writes for close at 1675778596593Writing region close event to WAL at 1675778596593Closed at 1675778596593 2023-02-07 14:03:16,594 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:16,594 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:16,594 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. after waiting 0 ms 2023-02-07 14:03:16,594 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:16,594 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:16,594 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for bc79e3a18b31e18d3202857c81987c1c: Waiting for close lock at 1675778596593Disabling compacts and flushes for region at 1675778596593Disabling writes for close at 1675778596594 (+1 ms)Writing region close event to WAL at 1675778596594Closed at 1675778596594 2023-02-07 14:03:16,595 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 8cac1335a37cfd271778dece578dc88b, disabling compactions & flushes 2023-02-07 14:03:16,595 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:16,595 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:16,595 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. after waiting 0 ms 2023-02-07 14:03:16,595 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:16,595 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:16,596 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 8cac1335a37cfd271778dece578dc88b: Waiting for close lock at 1675778596595Disabling compacts and flushes for region at 1675778596595Disabling writes for close at 1675778596595Writing region close event to WAL at 1675778596595Closed at 1675778596595 2023-02-07 14:03:16,596 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:16,596 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ab25ce00594a49cf9390c9116c456877 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,598 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 25ac6bea21c84f01b1c1a8d2585e60fb from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:16,599 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 3d27aaddb20d932428863d8eda2399b2, disabling compactions & flushes 2023-02-07 14:03:16,600 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:16,600 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:16,600 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. after waiting 0 ms 2023-02-07 14:03:16,600 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:16,600 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:16,600 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 3d27aaddb20d932428863d8eda2399b2: Waiting for close lock at 1675778596599Disabling compacts and flushes for region at 1675778596599Disabling writes for close at 1675778596600 (+1 ms)Writing region close event to WAL at 1675778596600Closed at 1675778596600 2023-02-07 14:03:16,600 INFO [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1675778594864 type: FLUSH version: 2 ttl: 0 2023-02-07 14:03:16,600 DEBUG [Listener at localhost/45865] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d 2023-02-07 14:03:16,600 DEBUG [Listener at localhost/45865] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d 2023-02-07 14:03:16,601 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-data/ 2023-02-07 14:03:16,601 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |----default/ 2023-02-07 14:03:16,601 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-07 14:03:16,602 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |----------1480baf3a921359925457313a52e67f8/ 2023-02-07 14:03:16,602 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:16,602 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:16,603 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1480baf3a921359925457313a52e67f8-052498e3e71b499fa32e97117a16cb76 2023-02-07 14:03:16,603 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:16,603 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1480baf3a921359925457313a52e67f8-fc061ce0980f4017b9b281f3ed4aeb0a 2023-02-07 14:03:16,603 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |----------3d27aaddb20d932428863d8eda2399b2/ 2023-02-07 14:03:16,603 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:16,603 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:16,604 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3d27aaddb20d932428863d8eda2399b2-ab25ce00594a49cf9390c9116c456877 2023-02-07 14:03:16,604 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:16,604 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3d27aaddb20d932428863d8eda2399b2-25ac6bea21c84f01b1c1a8d2585e60fb 2023-02-07 14:03:16,604 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |----------56002cf8b83f4276529438d13b773bb8/ 2023-02-07 14:03:16,604 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:16,604 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:16,605 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=56002cf8b83f4276529438d13b773bb8-7907380e90f541cca95857ccbc76e75c 2023-02-07 14:03:16,605 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:16,605 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=56002cf8b83f4276529438d13b773bb8-88111b54bbdf4212a651b743d690da07 2023-02-07 14:03:16,605 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |----------6a24f898703d5e53fde0a818f5deba08/ 2023-02-07 14:03:16,605 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:16,605 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:16,606 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6a24f898703d5e53fde0a818f5deba08-b3cd015900374c20adaa588e1d9906e2 2023-02-07 14:03:16,606 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:16,606 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6a24f898703d5e53fde0a818f5deba08-0716f7217e64439f8a49dc7a2dd96e22 2023-02-07 14:03:16,606 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |----------7b537e9af0f831a97df0ff3a15af9fe4/ 2023-02-07 14:03:16,606 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:16,606 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |----------817b819a97bae6e7ccdc3339bba18bec/ 2023-02-07 14:03:16,607 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:16,607 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |----------8cac1335a37cfd271778dece578dc88b/ 2023-02-07 14:03:16,607 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:16,607 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:16,607 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8cac1335a37cfd271778dece578dc88b-355d547fbbd9448a969e9ab91bbbd1cd 2023-02-07 14:03:16,607 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:16,607 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8cac1335a37cfd271778dece578dc88b-a0651377e9004ed99e6ad20d5723e839 2023-02-07 14:03:16,607 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |----------8db3168d240af3f198f5e5aee2b07fe8/ 2023-02-07 14:03:16,608 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:16,608 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:16,608 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8db3168d240af3f198f5e5aee2b07fe8-498c8183851f415aade9b9588d9be131 2023-02-07 14:03:16,608 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:16,608 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8db3168d240af3f198f5e5aee2b07fe8-114841eba3da43d0835af7edc37a3434 2023-02-07 14:03:16,608 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |----------bc79e3a18b31e18d3202857c81987c1c/ 2023-02-07 14:03:16,609 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:16,609 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:16,609 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=bc79e3a18b31e18d3202857c81987c1c-19042036c746481fb4464227e5fbac07 2023-02-07 14:03:16,609 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:16,609 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=bc79e3a18b31e18d3202857c81987c1c-b12d2a47ba864732810a6f73d52468d3 2023-02-07 14:03:16,609 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |----------cd032384c7aae39dc559f0ab4870f85a/ 2023-02-07 14:03:16,610 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:16,610 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:16,610 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=cd032384c7aae39dc559f0ab4870f85a-569d1779835b4c6f9e623e7507ff742b 2023-02-07 14:03:16,610 DEBUG [Listener at localhost/45865] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:16,610 DEBUG [Listener at localhost/45865] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=cd032384c7aae39dc559f0ab4870f85a-85fe7fe2f7314b77a7a1cc92507e7458 2023-02-07 14:03:16,613 INFO [Listener at localhost/45865] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 14:03:17,298 DEBUG [Listener at localhost/45865] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:17,298 INFO [Listener at localhost/45865] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:17,299 DEBUG [Listener at localhost/45865] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:17,304 INFO [StoreOpener-1480baf3a921359925457313a52e67f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1480baf3a921359925457313a52e67f8 2023-02-07 14:03:17,304 DEBUG [StoreOpener-1480baf3a921359925457313a52e67f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1 2023-02-07 14:03:17,305 INFO [StoreOpener-1480baf3a921359925457313a52e67f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1480baf3a921359925457313a52e67f8 columnFamilyName f1 2023-02-07 14:03:17,309 DEBUG [StoreOpener-1480baf3a921359925457313a52e67f8-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1/testWithMockedMapReduceMultiRegion=1480baf3a921359925457313a52e67f8-052498e3e71b499fa32e97117a16cb76 2023-02-07 14:03:17,309 INFO [StoreOpener-1480baf3a921359925457313a52e67f8-1] regionserver.HStore(310): Store=1480baf3a921359925457313a52e67f8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,309 INFO [StoreOpener-1480baf3a921359925457313a52e67f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1480baf3a921359925457313a52e67f8 2023-02-07 14:03:17,310 DEBUG [StoreOpener-1480baf3a921359925457313a52e67f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2 2023-02-07 14:03:17,310 INFO [StoreOpener-1480baf3a921359925457313a52e67f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1480baf3a921359925457313a52e67f8 columnFamilyName f2 2023-02-07 14:03:17,314 DEBUG [StoreOpener-1480baf3a921359925457313a52e67f8-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2/testWithMockedMapReduceMultiRegion=1480baf3a921359925457313a52e67f8-fc061ce0980f4017b9b281f3ed4aeb0a 2023-02-07 14:03:17,314 INFO [StoreOpener-1480baf3a921359925457313a52e67f8-1] regionserver.HStore(310): Store=1480baf3a921359925457313a52e67f8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,314 DEBUG [Listener at localhost/45865] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:17,314 INFO [Listener at localhost/45865] regionserver.HRegion(1071): Opened 1480baf3a921359925457313a52e67f8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74935959, jitterRate=0.11663280427455902}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:17,314 DEBUG [Listener at localhost/45865] regionserver.HRegion(964): Region open journal for 1480baf3a921359925457313a52e67f8: Writing region info on filesystem at 1675778597300Initializing all the Stores at 1675778597301 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597301Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597303 (+2 ms)Region opened successfully at 1675778597314 (+11 ms) 2023-02-07 14:03:17,324 DEBUG [Listener at localhost/45865] regionserver.HRegion(1603): Closing 1480baf3a921359925457313a52e67f8, disabling compactions & flushes 2023-02-07 14:03:17,324 INFO [Listener at localhost/45865] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:17,324 DEBUG [Listener at localhost/45865] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:17,324 DEBUG [Listener at localhost/45865] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. after waiting 0 ms 2023-02-07 14:03:17,324 DEBUG [Listener at localhost/45865] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:17,325 INFO [Listener at localhost/45865] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:17,325 DEBUG [Listener at localhost/45865] regionserver.HRegion(1557): Region close journal for 1480baf3a921359925457313a52e67f8: Waiting for close lock at 1675778597324Disabling compacts and flushes for region at 1675778597324Disabling writes for close at 1675778597324Writing region close event to WAL at 1675778597325 (+1 ms)Closed at 1675778597325 2023-02-07 14:03:17,325 DEBUG [Listener at localhost/45865] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:17,326 INFO [Listener at localhost/45865] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:17,327 DEBUG [Listener at localhost/45865] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:17,329 INFO [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:17,330 DEBUG [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1 2023-02-07 14:03:17,330 INFO [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d27aaddb20d932428863d8eda2399b2 columnFamilyName f1 2023-02-07 14:03:17,334 DEBUG [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1/testWithMockedMapReduceMultiRegion=3d27aaddb20d932428863d8eda2399b2-ab25ce00594a49cf9390c9116c456877 2023-02-07 14:03:17,334 INFO [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] regionserver.HStore(310): Store=3d27aaddb20d932428863d8eda2399b2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,334 INFO [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:17,335 DEBUG [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2 2023-02-07 14:03:17,335 INFO [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3d27aaddb20d932428863d8eda2399b2 columnFamilyName f2 2023-02-07 14:03:17,338 DEBUG [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2/testWithMockedMapReduceMultiRegion=3d27aaddb20d932428863d8eda2399b2-25ac6bea21c84f01b1c1a8d2585e60fb 2023-02-07 14:03:17,339 INFO [StoreOpener-3d27aaddb20d932428863d8eda2399b2-1] regionserver.HStore(310): Store=3d27aaddb20d932428863d8eda2399b2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,339 DEBUG [Listener at localhost/45865] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:17,339 INFO [Listener at localhost/45865] regionserver.HRegion(1071): Opened 3d27aaddb20d932428863d8eda2399b2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74415421, jitterRate=0.10887618362903595}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:17,339 DEBUG [Listener at localhost/45865] regionserver.HRegion(964): Region open journal for 3d27aaddb20d932428863d8eda2399b2: Writing region info on filesystem at 1675778597327Initializing all the Stores at 1675778597328 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597328Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597328Region opened successfully at 1675778597339 (+11 ms) 2023-02-07 14:03:17,347 DEBUG [Listener at localhost/45865] regionserver.HRegion(1603): Closing 3d27aaddb20d932428863d8eda2399b2, disabling compactions & flushes 2023-02-07 14:03:17,348 INFO [Listener at localhost/45865] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:17,348 DEBUG [Listener at localhost/45865] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:17,348 DEBUG [Listener at localhost/45865] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. after waiting 0 ms 2023-02-07 14:03:17,348 DEBUG [Listener at localhost/45865] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:17,349 INFO [Listener at localhost/45865] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:17,349 DEBUG [Listener at localhost/45865] regionserver.HRegion(1557): Region close journal for 3d27aaddb20d932428863d8eda2399b2: Waiting for close lock at 1675778597347Disabling compacts and flushes for region at 1675778597347Disabling writes for close at 1675778597348 (+1 ms)Writing region close event to WAL at 1675778597349 (+1 ms)Closed at 1675778597349 2023-02-07 14:03:17,349 DEBUG [Listener at localhost/45865] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:17,349 INFO [Listener at localhost/45865] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:17,350 DEBUG [Listener at localhost/45865] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:17,352 INFO [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:17,353 DEBUG [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1 2023-02-07 14:03:17,353 INFO [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cac1335a37cfd271778dece578dc88b columnFamilyName f1 2023-02-07 14:03:17,356 DEBUG [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1/testWithMockedMapReduceMultiRegion=8cac1335a37cfd271778dece578dc88b-355d547fbbd9448a969e9ab91bbbd1cd 2023-02-07 14:03:17,357 INFO [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] regionserver.HStore(310): Store=8cac1335a37cfd271778dece578dc88b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,357 INFO [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:17,357 DEBUG [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2 2023-02-07 14:03:17,358 INFO [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cac1335a37cfd271778dece578dc88b columnFamilyName f2 2023-02-07 14:03:17,361 DEBUG [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2/testWithMockedMapReduceMultiRegion=8cac1335a37cfd271778dece578dc88b-a0651377e9004ed99e6ad20d5723e839 2023-02-07 14:03:17,361 INFO [StoreOpener-8cac1335a37cfd271778dece578dc88b-1] regionserver.HStore(310): Store=8cac1335a37cfd271778dece578dc88b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,361 DEBUG [Listener at localhost/45865] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:17,361 INFO [Listener at localhost/45865] regionserver.HRegion(1071): Opened 8cac1335a37cfd271778dece578dc88b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64799575, jitterRate=-0.03441108763217926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:17,361 DEBUG [Listener at localhost/45865] regionserver.HRegion(964): Region open journal for 8cac1335a37cfd271778dece578dc88b: Writing region info on filesystem at 1675778597350Initializing all the Stores at 1675778597351 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597351Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597351Region opened successfully at 1675778597361 (+10 ms) 2023-02-07 14:03:17,369 DEBUG [Listener at localhost/45865] regionserver.HRegion(1603): Closing 8cac1335a37cfd271778dece578dc88b, disabling compactions & flushes 2023-02-07 14:03:17,369 INFO [Listener at localhost/45865] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:17,369 DEBUG [Listener at localhost/45865] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:17,370 DEBUG [Listener at localhost/45865] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. after waiting 0 ms 2023-02-07 14:03:17,370 DEBUG [Listener at localhost/45865] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:17,370 INFO [Listener at localhost/45865] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:17,370 DEBUG [Listener at localhost/45865] regionserver.HRegion(1557): Region close journal for 8cac1335a37cfd271778dece578dc88b: Waiting for close lock at 1675778597369Disabling compacts and flushes for region at 1675778597369Disabling writes for close at 1675778597370 (+1 ms)Writing region close event to WAL at 1675778597370Closed at 1675778597370 2023-02-07 14:03:17,371 DEBUG [Listener at localhost/45865] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:17,371 INFO [Listener at localhost/45865] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:17,372 DEBUG [Listener at localhost/45865] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:17,374 INFO [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:17,375 DEBUG [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec/f1 2023-02-07 14:03:17,376 INFO [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 817b819a97bae6e7ccdc3339bba18bec columnFamilyName f1 2023-02-07 14:03:17,376 INFO [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] regionserver.HStore(310): Store=817b819a97bae6e7ccdc3339bba18bec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,376 INFO [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:17,377 DEBUG [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec/f2 2023-02-07 14:03:17,377 INFO [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 817b819a97bae6e7ccdc3339bba18bec columnFamilyName f2 2023-02-07 14:03:17,378 INFO [StoreOpener-817b819a97bae6e7ccdc3339bba18bec-1] regionserver.HStore(310): Store=817b819a97bae6e7ccdc3339bba18bec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,378 DEBUG [Listener at localhost/45865] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:17,378 INFO [Listener at localhost/45865] regionserver.HRegion(1071): Opened 817b819a97bae6e7ccdc3339bba18bec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71588507, jitterRate=0.0667518824338913}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:17,378 DEBUG [Listener at localhost/45865] regionserver.HRegion(964): Region open journal for 817b819a97bae6e7ccdc3339bba18bec: Writing region info on filesystem at 1675778597372Initializing all the Stores at 1675778597373 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597373Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597373Region opened successfully at 1675778597378 (+5 ms) 2023-02-07 14:03:17,378 DEBUG [Listener at localhost/45865] regionserver.HRegion(1603): Closing 817b819a97bae6e7ccdc3339bba18bec, disabling compactions & flushes 2023-02-07 14:03:17,379 INFO [Listener at localhost/45865] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:17,379 DEBUG [Listener at localhost/45865] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:17,379 DEBUG [Listener at localhost/45865] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. after waiting 0 ms 2023-02-07 14:03:17,379 DEBUG [Listener at localhost/45865] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:17,379 INFO [Listener at localhost/45865] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:17,379 DEBUG [Listener at localhost/45865] regionserver.HRegion(1557): Region close journal for 817b819a97bae6e7ccdc3339bba18bec: Waiting for close lock at 1675778597378Disabling compacts and flushes for region at 1675778597378Disabling writes for close at 1675778597379 (+1 ms)Writing region close event to WAL at 1675778597379Closed at 1675778597379 2023-02-07 14:03:17,379 DEBUG [Listener at localhost/45865] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:17,380 INFO [Listener at localhost/45865] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:17,381 DEBUG [Listener at localhost/45865] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:17,382 INFO [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:17,383 DEBUG [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1 2023-02-07 14:03:17,383 INFO [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8db3168d240af3f198f5e5aee2b07fe8 columnFamilyName f1 2023-02-07 14:03:17,388 DEBUG [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1/testWithMockedMapReduceMultiRegion=8db3168d240af3f198f5e5aee2b07fe8-498c8183851f415aade9b9588d9be131 2023-02-07 14:03:17,388 INFO [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] regionserver.HStore(310): Store=8db3168d240af3f198f5e5aee2b07fe8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,388 INFO [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:17,389 DEBUG [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2 2023-02-07 14:03:17,389 INFO [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8db3168d240af3f198f5e5aee2b07fe8 columnFamilyName f2 2023-02-07 14:03:17,392 DEBUG [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2/testWithMockedMapReduceMultiRegion=8db3168d240af3f198f5e5aee2b07fe8-114841eba3da43d0835af7edc37a3434 2023-02-07 14:03:17,393 INFO [StoreOpener-8db3168d240af3f198f5e5aee2b07fe8-1] regionserver.HStore(310): Store=8db3168d240af3f198f5e5aee2b07fe8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,393 DEBUG [Listener at localhost/45865] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:17,393 INFO [Listener at localhost/45865] regionserver.HRegion(1071): Opened 8db3168d240af3f198f5e5aee2b07fe8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61698665, jitterRate=-0.0806182473897934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:17,393 DEBUG [Listener at localhost/45865] regionserver.HRegion(964): Region open journal for 8db3168d240af3f198f5e5aee2b07fe8: Writing region info on filesystem at 1675778597381Initializing all the Stores at 1675778597381Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597381Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597382 (+1 ms)Region opened successfully at 1675778597393 (+11 ms) 2023-02-07 14:03:17,403 DEBUG [Listener at localhost/45865] regionserver.HRegion(1603): Closing 8db3168d240af3f198f5e5aee2b07fe8, disabling compactions & flushes 2023-02-07 14:03:17,403 INFO [Listener at localhost/45865] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:17,403 DEBUG [Listener at localhost/45865] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:17,403 DEBUG [Listener at localhost/45865] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. after waiting 0 ms 2023-02-07 14:03:17,403 DEBUG [Listener at localhost/45865] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:17,404 INFO [Listener at localhost/45865] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:17,404 DEBUG [Listener at localhost/45865] regionserver.HRegion(1557): Region close journal for 8db3168d240af3f198f5e5aee2b07fe8: Waiting for close lock at 1675778597403Disabling compacts and flushes for region at 1675778597403Disabling writes for close at 1675778597403Writing region close event to WAL at 1675778597404 (+1 ms)Closed at 1675778597404 2023-02-07 14:03:17,404 DEBUG [Listener at localhost/45865] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:17,404 INFO [Listener at localhost/45865] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:17,409 DEBUG [Listener at localhost/45865] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:17,411 INFO [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:17,412 DEBUG [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1 2023-02-07 14:03:17,412 INFO [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a24f898703d5e53fde0a818f5deba08 columnFamilyName f1 2023-02-07 14:03:17,417 DEBUG [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1/testWithMockedMapReduceMultiRegion=6a24f898703d5e53fde0a818f5deba08-b3cd015900374c20adaa588e1d9906e2 2023-02-07 14:03:17,417 INFO [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] regionserver.HStore(310): Store=6a24f898703d5e53fde0a818f5deba08/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,417 INFO [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:17,418 DEBUG [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2 2023-02-07 14:03:17,418 INFO [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a24f898703d5e53fde0a818f5deba08 columnFamilyName f2 2023-02-07 14:03:17,422 DEBUG [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2/testWithMockedMapReduceMultiRegion=6a24f898703d5e53fde0a818f5deba08-0716f7217e64439f8a49dc7a2dd96e22 2023-02-07 14:03:17,422 INFO [StoreOpener-6a24f898703d5e53fde0a818f5deba08-1] regionserver.HStore(310): Store=6a24f898703d5e53fde0a818f5deba08/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,422 DEBUG [Listener at localhost/45865] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:17,422 INFO [Listener at localhost/45865] regionserver.HRegion(1071): Opened 6a24f898703d5e53fde0a818f5deba08; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67327467, jitterRate=0.003257438540458679}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:17,422 DEBUG [Listener at localhost/45865] regionserver.HRegion(964): Region open journal for 6a24f898703d5e53fde0a818f5deba08: Writing region info on filesystem at 1675778597409Initializing all the Stores at 1675778597410 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597410Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597410Region opened successfully at 1675778597422 (+12 ms) 2023-02-07 14:03:17,434 DEBUG [Listener at localhost/45865] regionserver.HRegion(1603): Closing 6a24f898703d5e53fde0a818f5deba08, disabling compactions & flushes 2023-02-07 14:03:17,435 INFO [Listener at localhost/45865] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:17,435 DEBUG [Listener at localhost/45865] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:17,435 DEBUG [Listener at localhost/45865] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. after waiting 0 ms 2023-02-07 14:03:17,435 DEBUG [Listener at localhost/45865] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:17,436 INFO [Listener at localhost/45865] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:17,436 DEBUG [Listener at localhost/45865] regionserver.HRegion(1557): Region close journal for 6a24f898703d5e53fde0a818f5deba08: Waiting for close lock at 1675778597434Disabling compacts and flushes for region at 1675778597434Disabling writes for close at 1675778597435 (+1 ms)Writing region close event to WAL at 1675778597436 (+1 ms)Closed at 1675778597436 2023-02-07 14:03:17,437 DEBUG [Listener at localhost/45865] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:17,437 INFO [Listener at localhost/45865] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:17,438 DEBUG [Listener at localhost/45865] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:17,440 INFO [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:17,441 DEBUG [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1 2023-02-07 14:03:17,441 INFO [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56002cf8b83f4276529438d13b773bb8 columnFamilyName f1 2023-02-07 14:03:17,445 DEBUG [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1/testWithMockedMapReduceMultiRegion=56002cf8b83f4276529438d13b773bb8-7907380e90f541cca95857ccbc76e75c 2023-02-07 14:03:17,445 INFO [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] regionserver.HStore(310): Store=56002cf8b83f4276529438d13b773bb8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,445 INFO [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:17,446 DEBUG [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2 2023-02-07 14:03:17,446 INFO [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56002cf8b83f4276529438d13b773bb8 columnFamilyName f2 2023-02-07 14:03:17,450 DEBUG [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2/testWithMockedMapReduceMultiRegion=56002cf8b83f4276529438d13b773bb8-88111b54bbdf4212a651b743d690da07 2023-02-07 14:03:17,450 INFO [StoreOpener-56002cf8b83f4276529438d13b773bb8-1] regionserver.HStore(310): Store=56002cf8b83f4276529438d13b773bb8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,450 DEBUG [Listener at localhost/45865] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:17,450 INFO [Listener at localhost/45865] regionserver.HRegion(1071): Opened 56002cf8b83f4276529438d13b773bb8; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68870985, jitterRate=0.026257649064064026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:17,450 DEBUG [Listener at localhost/45865] regionserver.HRegion(964): Region open journal for 56002cf8b83f4276529438d13b773bb8: Writing region info on filesystem at 1675778597439Initializing all the Stores at 1675778597439Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597439Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597439Region opened successfully at 1675778597450 (+11 ms) 2023-02-07 14:03:17,458 DEBUG [Listener at localhost/45865] regionserver.HRegion(1603): Closing 56002cf8b83f4276529438d13b773bb8, disabling compactions & flushes 2023-02-07 14:03:17,459 INFO [Listener at localhost/45865] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:17,459 DEBUG [Listener at localhost/45865] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:17,459 DEBUG [Listener at localhost/45865] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. after waiting 0 ms 2023-02-07 14:03:17,459 DEBUG [Listener at localhost/45865] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:17,460 INFO [Listener at localhost/45865] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:17,460 DEBUG [Listener at localhost/45865] regionserver.HRegion(1557): Region close journal for 56002cf8b83f4276529438d13b773bb8: Waiting for close lock at 1675778597458Disabling compacts and flushes for region at 1675778597458Disabling writes for close at 1675778597459 (+1 ms)Writing region close event to WAL at 1675778597460 (+1 ms)Closed at 1675778597460 2023-02-07 14:03:17,460 DEBUG [Listener at localhost/45865] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:17,460 INFO [Listener at localhost/45865] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:17,462 DEBUG [Listener at localhost/45865] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:17,463 INFO [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:17,464 DEBUG [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1 2023-02-07 14:03:17,464 INFO [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd032384c7aae39dc559f0ab4870f85a columnFamilyName f1 2023-02-07 14:03:17,468 DEBUG [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1/testWithMockedMapReduceMultiRegion=cd032384c7aae39dc559f0ab4870f85a-569d1779835b4c6f9e623e7507ff742b 2023-02-07 14:03:17,468 INFO [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] regionserver.HStore(310): Store=cd032384c7aae39dc559f0ab4870f85a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,468 INFO [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:17,469 DEBUG [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2 2023-02-07 14:03:17,469 INFO [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd032384c7aae39dc559f0ab4870f85a columnFamilyName f2 2023-02-07 14:03:17,472 DEBUG [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2/testWithMockedMapReduceMultiRegion=cd032384c7aae39dc559f0ab4870f85a-85fe7fe2f7314b77a7a1cc92507e7458 2023-02-07 14:03:17,472 INFO [StoreOpener-cd032384c7aae39dc559f0ab4870f85a-1] regionserver.HStore(310): Store=cd032384c7aae39dc559f0ab4870f85a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,472 DEBUG [Listener at localhost/45865] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:17,472 INFO [Listener at localhost/45865] regionserver.HRegion(1071): Opened cd032384c7aae39dc559f0ab4870f85a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68468316, jitterRate=0.020257413387298584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:17,472 DEBUG [Listener at localhost/45865] regionserver.HRegion(964): Region open journal for cd032384c7aae39dc559f0ab4870f85a: Writing region info on filesystem at 1675778597462Initializing all the Stores at 1675778597462Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597462Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597462Region opened successfully at 1675778597472 (+10 ms) 2023-02-07 14:03:17,484 DEBUG [Listener at localhost/45865] regionserver.HRegion(1603): Closing cd032384c7aae39dc559f0ab4870f85a, disabling compactions & flushes 2023-02-07 14:03:17,484 INFO [Listener at localhost/45865] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:17,484 DEBUG [Listener at localhost/45865] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:17,484 DEBUG [Listener at localhost/45865] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. after waiting 0 ms 2023-02-07 14:03:17,484 DEBUG [Listener at localhost/45865] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:17,485 INFO [Listener at localhost/45865] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:17,485 DEBUG [Listener at localhost/45865] regionserver.HRegion(1557): Region close journal for cd032384c7aae39dc559f0ab4870f85a: Waiting for close lock at 1675778597484Disabling compacts and flushes for region at 1675778597484Disabling writes for close at 1675778597484Writing region close event to WAL at 1675778597485 (+1 ms)Closed at 1675778597485 2023-02-07 14:03:17,485 DEBUG [Listener at localhost/45865] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:17,486 INFO [Listener at localhost/45865] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:17,487 DEBUG [Listener at localhost/45865] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:17,489 INFO [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:17,490 DEBUG [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4/f1 2023-02-07 14:03:17,490 INFO [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b537e9af0f831a97df0ff3a15af9fe4 columnFamilyName f1 2023-02-07 14:03:17,490 INFO [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] regionserver.HStore(310): Store=7b537e9af0f831a97df0ff3a15af9fe4/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,490 INFO [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:17,491 DEBUG [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4/f2 2023-02-07 14:03:17,491 INFO [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b537e9af0f831a97df0ff3a15af9fe4 columnFamilyName f2 2023-02-07 14:03:17,492 INFO [StoreOpener-7b537e9af0f831a97df0ff3a15af9fe4-1] regionserver.HStore(310): Store=7b537e9af0f831a97df0ff3a15af9fe4/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,492 DEBUG [Listener at localhost/45865] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:17,492 INFO [Listener at localhost/45865] regionserver.HRegion(1071): Opened 7b537e9af0f831a97df0ff3a15af9fe4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70401446, jitterRate=0.049063295125961304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:17,492 DEBUG [Listener at localhost/45865] regionserver.HRegion(964): Region open journal for 7b537e9af0f831a97df0ff3a15af9fe4: Writing region info on filesystem at 1675778597487Initializing all the Stores at 1675778597488 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597488Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597488Region opened successfully at 1675778597492 (+4 ms) 2023-02-07 14:03:17,492 DEBUG [Listener at localhost/45865] regionserver.HRegion(1603): Closing 7b537e9af0f831a97df0ff3a15af9fe4, disabling compactions & flushes 2023-02-07 14:03:17,493 INFO [Listener at localhost/45865] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:17,493 DEBUG [Listener at localhost/45865] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:17,493 DEBUG [Listener at localhost/45865] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. after waiting 0 ms 2023-02-07 14:03:17,493 DEBUG [Listener at localhost/45865] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:17,493 INFO [Listener at localhost/45865] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:17,493 DEBUG [Listener at localhost/45865] regionserver.HRegion(1557): Region close journal for 7b537e9af0f831a97df0ff3a15af9fe4: Waiting for close lock at 1675778597492Disabling compacts and flushes for region at 1675778597492Disabling writes for close at 1675778597493 (+1 ms)Writing region close event to WAL at 1675778597493Closed at 1675778597493 2023-02-07 14:03:17,494 DEBUG [Listener at localhost/45865] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:17,494 INFO [Listener at localhost/45865] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:17,496 DEBUG [Listener at localhost/45865] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:17,497 INFO [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:17,498 DEBUG [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1 2023-02-07 14:03:17,498 INFO [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc79e3a18b31e18d3202857c81987c1c columnFamilyName f1 2023-02-07 14:03:17,502 DEBUG [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1/testWithMockedMapReduceMultiRegion=bc79e3a18b31e18d3202857c81987c1c-19042036c746481fb4464227e5fbac07 2023-02-07 14:03:17,502 INFO [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] regionserver.HStore(310): Store=bc79e3a18b31e18d3202857c81987c1c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,502 INFO [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:17,503 DEBUG [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2 2023-02-07 14:03:17,503 INFO [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc79e3a18b31e18d3202857c81987c1c columnFamilyName f2 2023-02-07 14:03:17,506 DEBUG [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] regionserver.HStore(539): loaded hdfs://localhost:38577/user/jenkins/test-data/011e4e63-c527-3656-f4bd-3ec76beebef0/testWithMockedMapReduceMultiRegion/103c7f8c-3314-4604-9023-04bfb099215d/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2/testWithMockedMapReduceMultiRegion=bc79e3a18b31e18d3202857c81987c1c-b12d2a47ba864732810a6f73d52468d3 2023-02-07 14:03:17,506 INFO [StoreOpener-bc79e3a18b31e18d3202857c81987c1c-1] regionserver.HStore(310): Store=bc79e3a18b31e18d3202857c81987c1c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:17,507 DEBUG [Listener at localhost/45865] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:17,507 INFO [Listener at localhost/45865] regionserver.HRegion(1071): Opened bc79e3a18b31e18d3202857c81987c1c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63628933, jitterRate=-0.05185501277446747}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:17,507 DEBUG [Listener at localhost/45865] regionserver.HRegion(964): Region open journal for bc79e3a18b31e18d3202857c81987c1c: Writing region info on filesystem at 1675778597496Initializing all the Stores at 1675778597496Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597496Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778597496Region opened successfully at 1675778597507 (+11 ms) 2023-02-07 14:03:17,515 DEBUG [Listener at localhost/45865] regionserver.HRegion(1603): Closing bc79e3a18b31e18d3202857c81987c1c, disabling compactions & flushes 2023-02-07 14:03:17,515 INFO [Listener at localhost/45865] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:17,515 DEBUG [Listener at localhost/45865] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:17,515 DEBUG [Listener at localhost/45865] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. after waiting 0 ms 2023-02-07 14:03:17,515 DEBUG [Listener at localhost/45865] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:17,516 INFO [Listener at localhost/45865] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:17,516 DEBUG [Listener at localhost/45865] regionserver.HRegion(1557): Region close journal for bc79e3a18b31e18d3202857c81987c1c: Waiting for close lock at 1675778597515Disabling compacts and flushes for region at 1675778597515Disabling writes for close at 1675778597515Writing region close event to WAL at 1675778597516 (+1 ms)Closed at 1675778597516 2023-02-07 14:03:17,519 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:17,519 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:17,520 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-07 14:03:17,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-07 14:03:17,523 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:17,523 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:17,523 INFO [Listener at localhost/45865] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-07 14:03:17,524 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-07 14:03:17,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:17,526 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:17,526 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:17,527 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778597527"}]},"ts":"1675778597527"} 2023-02-07 14:03:17,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 14:03:17,528 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-07 14:03:17,530 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-07 14:03:17,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=817b819a97bae6e7ccdc3339bba18bec, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8db3168d240af3f198f5e5aee2b07fe8, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a24f898703d5e53fde0a818f5deba08, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc79e3a18b31e18d3202857c81987c1c, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cd032384c7aae39dc559f0ab4870f85a, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3d27aaddb20d932428863d8eda2399b2, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8cac1335a37cfd271778dece578dc88b, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=56002cf8b83f4276529438d13b773bb8, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1480baf3a921359925457313a52e67f8, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b537e9af0f831a97df0ff3a15af9fe4, UNASSIGN}] 2023-02-07 14:03:17,532 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8db3168d240af3f198f5e5aee2b07fe8, UNASSIGN 2023-02-07 14:03:17,532 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a24f898703d5e53fde0a818f5deba08, UNASSIGN 2023-02-07 14:03:17,532 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=817b819a97bae6e7ccdc3339bba18bec, UNASSIGN 2023-02-07 14:03:17,532 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc79e3a18b31e18d3202857c81987c1c, UNASSIGN 2023-02-07 14:03:17,533 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b537e9af0f831a97df0ff3a15af9fe4, UNASSIGN 2023-02-07 14:03:17,533 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=8db3168d240af3f198f5e5aee2b07fe8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:17,533 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=6a24f898703d5e53fde0a818f5deba08, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:17,533 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597533"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778597533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778597533"}]},"ts":"1675778597533"} 2023-02-07 14:03:17,533 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=817b819a97bae6e7ccdc3339bba18bec, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:17,533 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=bc79e3a18b31e18d3202857c81987c1c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:17,533 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7b537e9af0f831a97df0ff3a15af9fe4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:17,533 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597533"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778597533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778597533"}]},"ts":"1675778597533"} 2023-02-07 14:03:17,533 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675778597533"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778597533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778597533"}]},"ts":"1675778597533"} 2023-02-07 14:03:17,533 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597533"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778597533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778597533"}]},"ts":"1675778597533"} 2023-02-07 14:03:17,533 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675778597533"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778597533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778597533"}]},"ts":"1675778597533"} 2023-02-07 14:03:17,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=35, state=RUNNABLE; CloseRegionProcedure 8db3168d240af3f198f5e5aee2b07fe8, server=jenkins-hbase4.apache.org,45365,1675778592875}] 2023-02-07 14:03:17,535 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=36, state=RUNNABLE; CloseRegionProcedure 6a24f898703d5e53fde0a818f5deba08, server=jenkins-hbase4.apache.org,45365,1675778592875}] 2023-02-07 14:03:17,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; CloseRegionProcedure 7b537e9af0f831a97df0ff3a15af9fe4, server=jenkins-hbase4.apache.org,44239,1675778592805}] 2023-02-07 14:03:17,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=37, state=RUNNABLE; CloseRegionProcedure bc79e3a18b31e18d3202857c81987c1c, server=jenkins-hbase4.apache.org,44239,1675778592805}] 2023-02-07 14:03:17,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=34, state=RUNNABLE; CloseRegionProcedure 817b819a97bae6e7ccdc3339bba18bec, server=jenkins-hbase4.apache.org,44239,1675778592805}] 2023-02-07 14:03:17,537 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1480baf3a921359925457313a52e67f8, UNASSIGN 2023-02-07 14:03:17,537 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=56002cf8b83f4276529438d13b773bb8, UNASSIGN 2023-02-07 14:03:17,538 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=1480baf3a921359925457313a52e67f8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:17,538 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778597538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778597538"}]},"ts":"1675778597538"} 2023-02-07 14:03:17,538 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=56002cf8b83f4276529438d13b773bb8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:17,538 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778597538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778597538"}]},"ts":"1675778597538"} 2023-02-07 14:03:17,538 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8cac1335a37cfd271778dece578dc88b, UNASSIGN 2023-02-07 14:03:17,539 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3d27aaddb20d932428863d8eda2399b2, UNASSIGN 2023-02-07 14:03:17,539 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=8cac1335a37cfd271778dece578dc88b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:17,539 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597539"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778597539"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778597539"}]},"ts":"1675778597539"} 2023-02-07 14:03:17,539 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cd032384c7aae39dc559f0ab4870f85a, UNASSIGN 2023-02-07 14:03:17,539 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=3d27aaddb20d932428863d8eda2399b2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:17,539 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597539"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778597539"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778597539"}]},"ts":"1675778597539"} 2023-02-07 14:03:17,540 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cd032384c7aae39dc559f0ab4870f85a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:17,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 1480baf3a921359925457313a52e67f8, server=jenkins-hbase4.apache.org,44239,1675778592805}] 2023-02-07 14:03:17,540 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597540"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778597540"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778597540"}]},"ts":"1675778597540"} 2023-02-07 14:03:17,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 56002cf8b83f4276529438d13b773bb8, server=jenkins-hbase4.apache.org,45365,1675778592875}] 2023-02-07 14:03:17,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 8cac1335a37cfd271778dece578dc88b, server=jenkins-hbase4.apache.org,45365,1675778592875}] 2023-02-07 14:03:17,544 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 3d27aaddb20d932428863d8eda2399b2, server=jenkins-hbase4.apache.org,44239,1675778592805}] 2023-02-07 14:03:17,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=38, state=RUNNABLE; CloseRegionProcedure cd032384c7aae39dc559f0ab4870f85a, server=jenkins-hbase4.apache.org,45365,1675778592875}] 2023-02-07 14:03:17,628 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:17,628 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:17,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 14:03:17,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:17,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8db3168d240af3f198f5e5aee2b07fe8, disabling compactions & flushes 2023-02-07 14:03:17,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:17,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:17,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. after waiting 0 ms 2023-02-07 14:03:17,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:17,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1480baf3a921359925457313a52e67f8 2023-02-07 14:03:17,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1480baf3a921359925457313a52e67f8, disabling compactions & flushes 2023-02-07 14:03:17,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:17,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:17,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. after waiting 0 ms 2023-02-07 14:03:17,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:17,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:17,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:17,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8. 2023-02-07 14:03:17,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8. 2023-02-07 14:03:17,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8db3168d240af3f198f5e5aee2b07fe8: Waiting for close lock at 1675778597687Running coprocessor pre-close hooks at 1675778597687Disabling compacts and flushes for region at 1675778597687Disabling writes for close at 1675778597687Writing region close event to WAL at 1675778597688 (+1 ms)Running coprocessor post-close hooks at 1675778597691 (+3 ms)Closed at 1675778597691 2023-02-07 14:03:17,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1480baf3a921359925457313a52e67f8: Waiting for close lock at 1675778597688Running coprocessor pre-close hooks at 1675778597688Disabling compacts and flushes for region at 1675778597688Disabling writes for close at 1675778597688Writing region close event to WAL at 1675778597689 (+1 ms)Running coprocessor post-close hooks at 1675778597691 (+2 ms)Closed at 1675778597692 (+1 ms) 2023-02-07 14:03:17,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:17,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:17,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8cac1335a37cfd271778dece578dc88b, disabling compactions & flushes 2023-02-07 14:03:17,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:17,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:17,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. after waiting 0 ms 2023-02-07 14:03:17,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:17,693 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=8db3168d240af3f198f5e5aee2b07fe8, regionState=CLOSED 2023-02-07 14:03:17,693 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597693"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778597693"}]},"ts":"1675778597693"} 2023-02-07 14:03:17,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1480baf3a921359925457313a52e67f8 2023-02-07 14:03:17,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:17,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3d27aaddb20d932428863d8eda2399b2, disabling compactions & flushes 2023-02-07 14:03:17,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:17,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:17,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. after waiting 0 ms 2023-02-07 14:03:17,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:17,694 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=1480baf3a921359925457313a52e67f8, regionState=CLOSED 2023-02-07 14:03:17,694 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597694"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778597694"}]},"ts":"1675778597694"} 2023-02-07 14:03:17,696 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=35 2023-02-07 14:03:17,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=35, state=SUCCESS; CloseRegionProcedure 8db3168d240af3f198f5e5aee2b07fe8, server=jenkins-hbase4.apache.org,45365,1675778592875 in 161 msec 2023-02-07 14:03:17,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-07 14:03:17,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:17,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 1480baf3a921359925457313a52e67f8, server=jenkins-hbase4.apache.org,44239,1675778592805 in 155 msec 2023-02-07 14:03:17,698 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8db3168d240af3f198f5e5aee2b07fe8, UNASSIGN in 167 msec 2023-02-07 14:03:17,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b. 2023-02-07 14:03:17,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8cac1335a37cfd271778dece578dc88b: Waiting for close lock at 1675778597693Running coprocessor pre-close hooks at 1675778597693Disabling compacts and flushes for region at 1675778597693Disabling writes for close at 1675778597693Writing region close event to WAL at 1675778597694 (+1 ms)Running coprocessor post-close hooks at 1675778597698 (+4 ms)Closed at 1675778597698 2023-02-07 14:03:17,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:17,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2. 2023-02-07 14:03:17,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3d27aaddb20d932428863d8eda2399b2: Waiting for close lock at 1675778597694Running coprocessor pre-close hooks at 1675778597694Disabling compacts and flushes for region at 1675778597694Disabling writes for close at 1675778597694Writing region close event to WAL at 1675778597695 (+1 ms)Running coprocessor post-close hooks at 1675778597698 (+3 ms)Closed at 1675778597698 2023-02-07 14:03:17,700 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1480baf3a921359925457313a52e67f8, UNASSIGN in 167 msec 2023-02-07 14:03:17,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:17,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:17,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6a24f898703d5e53fde0a818f5deba08, disabling compactions & flushes 2023-02-07 14:03:17,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:17,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:17,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. after waiting 0 ms 2023-02-07 14:03:17,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:17,701 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=8cac1335a37cfd271778dece578dc88b, regionState=CLOSED 2023-02-07 14:03:17,701 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597701"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778597701"}]},"ts":"1675778597701"} 2023-02-07 14:03:17,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:17,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:17,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7b537e9af0f831a97df0ff3a15af9fe4, disabling compactions & flushes 2023-02-07 14:03:17,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:17,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:17,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. after waiting 0 ms 2023-02-07 14:03:17,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:17,701 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=3d27aaddb20d932428863d8eda2399b2, regionState=CLOSED 2023-02-07 14:03:17,701 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597701"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778597701"}]},"ts":"1675778597701"} 2023-02-07 14:03:17,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-07 14:03:17,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 8cac1335a37cfd271778dece578dc88b, server=jenkins-hbase4.apache.org,45365,1675778592875 in 161 msec 2023-02-07 14:03:17,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-07 14:03:17,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 3d27aaddb20d932428863d8eda2399b2, server=jenkins-hbase4.apache.org,44239,1675778592805 in 161 msec 2023-02-07 14:03:17,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 14:03:17,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8cac1335a37cfd271778dece578dc88b, UNASSIGN in 175 msec 2023-02-07 14:03:17,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4. 2023-02-07 14:03:17,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7b537e9af0f831a97df0ff3a15af9fe4: Waiting for close lock at 1675778597701Running coprocessor pre-close hooks at 1675778597701Disabling compacts and flushes for region at 1675778597701Disabling writes for close at 1675778597701Writing region close event to WAL at 1675778597702 (+1 ms)Running coprocessor post-close hooks at 1675778597706 (+4 ms)Closed at 1675778597706 2023-02-07 14:03:17,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3d27aaddb20d932428863d8eda2399b2, UNASSIGN in 175 msec 2023-02-07 14:03:17,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:17,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:17,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 817b819a97bae6e7ccdc3339bba18bec, disabling compactions & flushes 2023-02-07 14:03:17,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:17,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:17,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. after waiting 0 ms 2023-02-07 14:03:17,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:17,707 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7b537e9af0f831a97df0ff3a15af9fe4, regionState=CLOSED 2023-02-07 14:03:17,707 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675778597707"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778597707"}]},"ts":"1675778597707"} 2023-02-07 14:03:17,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:17,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08. 2023-02-07 14:03:17,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6a24f898703d5e53fde0a818f5deba08: Waiting for close lock at 1675778597700Running coprocessor pre-close hooks at 1675778597700Disabling compacts and flushes for region at 1675778597700Disabling writes for close at 1675778597701 (+1 ms)Writing region close event to WAL at 1675778597702 (+1 ms)Running coprocessor post-close hooks at 1675778597709 (+7 ms)Closed at 1675778597709 2023-02-07 14:03:17,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:17,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:17,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 56002cf8b83f4276529438d13b773bb8, disabling compactions & flushes 2023-02-07 14:03:17,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:17,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:17,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. after waiting 0 ms 2023-02-07 14:03:17,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:17,710 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=6a24f898703d5e53fde0a818f5deba08, regionState=CLOSED 2023-02-07 14:03:17,710 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597710"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778597710"}]},"ts":"1675778597710"} 2023-02-07 14:03:17,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-02-07 14:03:17,711 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; CloseRegionProcedure 7b537e9af0f831a97df0ff3a15af9fe4, server=jenkins-hbase4.apache.org,44239,1675778592805 in 174 msec 2023-02-07 14:03:17,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 14:03:17,712 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=7b537e9af0f831a97df0ff3a15af9fe4, UNASSIGN in 181 msec 2023-02-07 14:03:17,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec. 2023-02-07 14:03:17,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 817b819a97bae6e7ccdc3339bba18bec: Waiting for close lock at 1675778597707Running coprocessor pre-close hooks at 1675778597707Disabling compacts and flushes for region at 1675778597707Disabling writes for close at 1675778597707Writing region close event to WAL at 1675778597708 (+1 ms)Running coprocessor post-close hooks at 1675778597713 (+5 ms)Closed at 1675778597713 2023-02-07 14:03:17,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=36 2023-02-07 14:03:17,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=36, state=SUCCESS; CloseRegionProcedure 6a24f898703d5e53fde0a818f5deba08, server=jenkins-hbase4.apache.org,45365,1675778592875 in 177 msec 2023-02-07 14:03:17,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:17,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:17,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bc79e3a18b31e18d3202857c81987c1c, disabling compactions & flushes 2023-02-07 14:03:17,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:17,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:17,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. after waiting 0 ms 2023-02-07 14:03:17,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:17,714 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=817b819a97bae6e7ccdc3339bba18bec, regionState=CLOSED 2023-02-07 14:03:17,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6a24f898703d5e53fde0a818f5deba08, UNASSIGN in 183 msec 2023-02-07 14:03:17,714 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1675778597714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778597714"}]},"ts":"1675778597714"} 2023-02-07 14:03:17,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:17,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8. 2023-02-07 14:03:17,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 56002cf8b83f4276529438d13b773bb8: Waiting for close lock at 1675778597710Running coprocessor pre-close hooks at 1675778597710Disabling compacts and flushes for region at 1675778597710Disabling writes for close at 1675778597710Writing region close event to WAL at 1675778597712 (+2 ms)Running coprocessor post-close hooks at 1675778597716 (+4 ms)Closed at 1675778597716 2023-02-07 14:03:17,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=34 2023-02-07 14:03:17,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=34, state=SUCCESS; CloseRegionProcedure 817b819a97bae6e7ccdc3339bba18bec, server=jenkins-hbase4.apache.org,44239,1675778592805 in 178 msec 2023-02-07 14:03:17,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:17,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:17,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:17,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cd032384c7aae39dc559f0ab4870f85a, disabling compactions & flushes 2023-02-07 14:03:17,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:17,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:17,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. after waiting 0 ms 2023-02-07 14:03:17,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:17,718 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=56002cf8b83f4276529438d13b773bb8, regionState=CLOSED 2023-02-07 14:03:17,719 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597718"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778597718"}]},"ts":"1675778597718"} 2023-02-07 14:03:17,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c. 2023-02-07 14:03:17,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bc79e3a18b31e18d3202857c81987c1c: Waiting for close lock at 1675778597714Running coprocessor pre-close hooks at 1675778597714Disabling compacts and flushes for region at 1675778597714Disabling writes for close at 1675778597714Writing region close event to WAL at 1675778597715 (+1 ms)Running coprocessor post-close hooks at 1675778597719 (+4 ms)Closed at 1675778597719 2023-02-07 14:03:17,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=817b819a97bae6e7ccdc3339bba18bec, UNASSIGN in 188 msec 2023-02-07 14:03:17,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:17,720 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=bc79e3a18b31e18d3202857c81987c1c, regionState=CLOSED 2023-02-07 14:03:17,720 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597720"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778597720"}]},"ts":"1675778597720"} 2023-02-07 14:03:17,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-07 14:03:17,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 56002cf8b83f4276529438d13b773bb8, server=jenkins-hbase4.apache.org,45365,1675778592875 in 180 msec 2023-02-07 14:03:17,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=56002cf8b83f4276529438d13b773bb8, UNASSIGN in 191 msec 2023-02-07 14:03:17,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:17,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a. 2023-02-07 14:03:17,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cd032384c7aae39dc559f0ab4870f85a: Waiting for close lock at 1675778597718Running coprocessor pre-close hooks at 1675778597718Disabling compacts and flushes for region at 1675778597718Disabling writes for close at 1675778597718Writing region close event to WAL at 1675778597720 (+2 ms)Running coprocessor post-close hooks at 1675778597725 (+5 ms)Closed at 1675778597725 2023-02-07 14:03:17,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:17,726 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=cd032384c7aae39dc559f0ab4870f85a, regionState=CLOSED 2023-02-07 14:03:17,726 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1675778597726"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778597726"}]},"ts":"1675778597726"} 2023-02-07 14:03:17,730 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=37 2023-02-07 14:03:17,730 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=37, state=SUCCESS; CloseRegionProcedure bc79e3a18b31e18d3202857c81987c1c, server=jenkins-hbase4.apache.org,44239,1675778592805 in 193 msec 2023-02-07 14:03:17,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=38 2023-02-07 14:03:17,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=38, state=SUCCESS; CloseRegionProcedure cd032384c7aae39dc559f0ab4870f85a, server=jenkins-hbase4.apache.org,45365,1675778592875 in 184 msec 2023-02-07 14:03:17,731 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=bc79e3a18b31e18d3202857c81987c1c, UNASSIGN in 200 msec 2023-02-07 14:03:17,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=33 2023-02-07 14:03:17,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=cd032384c7aae39dc559f0ab4870f85a, UNASSIGN in 200 msec 2023-02-07 14:03:17,732 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778597732"}]},"ts":"1675778597732"} 2023-02-07 14:03:17,733 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-07 14:03:17,734 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-07 14:03:17,736 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 211 msec 2023-02-07 14:03:17,829 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:17,829 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:17,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-07 14:03:17,831 INFO [Listener at localhost/45865] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-07 14:03:17,831 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:17,831 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:17,832 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-07 14:03:17,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:17,834 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:17,834 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:17,834 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:17,835 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:17,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 14:03:17,845 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:17,845 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:17,845 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:17,845 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:17,845 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:17,845 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:17,845 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:17,845 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:17,848 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec/f1, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec/f2, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec/recovered.edits] 2023-02-07 14:03:17,849 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/recovered.edits] 2023-02-07 14:03:17,849 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/recovered.edits] 2023-02-07 14:03:17,850 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/recovered.edits] 2023-02-07 14:03:17,850 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/recovered.edits] 2023-02-07 14:03:17,850 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/recovered.edits] 2023-02-07 14:03:17,850 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/recovered.edits] 2023-02-07 14:03:17,851 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/recovered.edits] 2023-02-07 14:03:17,856 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1/355d547fbbd9448a969e9ab91bbbd1cd to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1/355d547fbbd9448a969e9ab91bbbd1cd 2023-02-07 14:03:17,859 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1/0180c48b5e7348b7b43960cb8551318e to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1/0180c48b5e7348b7b43960cb8551318e 2023-02-07 14:03:17,860 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1/8ff2fc2a618c41fe8a4a7bd7e129b073 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f1/8ff2fc2a618c41fe8a4a7bd7e129b073 2023-02-07 14:03:17,862 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1/7907380e90f541cca95857ccbc76e75c to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f1/7907380e90f541cca95857ccbc76e75c 2023-02-07 14:03:17,863 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1/ab25ce00594a49cf9390c9116c456877 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1/ab25ce00594a49cf9390c9116c456877 2023-02-07 14:03:17,863 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1/498c8183851f415aade9b9588d9be131 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1/498c8183851f415aade9b9588d9be131 2023-02-07 14:03:17,864 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec/recovered.edits/6.seqid to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec/recovered.edits/6.seqid 2023-02-07 14:03:17,864 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1/337d45cab4d847809272fba5fed7e72a to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1/337d45cab4d847809272fba5fed7e72a 2023-02-07 14:03:17,864 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1/0b60d700e3f342f88aa4f9d4470a0680 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1/0b60d700e3f342f88aa4f9d4470a0680 2023-02-07 14:03:17,865 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1/0b92aed332ea4c3d9d9e5fefe1d2d8b1 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1/0b92aed332ea4c3d9d9e5fefe1d2d8b1 2023-02-07 14:03:17,865 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/817b819a97bae6e7ccdc3339bba18bec 2023-02-07 14:03:17,865 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8 2023-02-07 14:03:17,865 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1/bab78cba95f5459d9649b1057cd8b5dc to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f1/bab78cba95f5459d9649b1057cd8b5dc 2023-02-07 14:03:17,866 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2/688869d1b8d849d99f790bcf2e28d4c8 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2/688869d1b8d849d99f790bcf2e28d4c8 2023-02-07 14:03:17,867 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1/b3cd015900374c20adaa588e1d9906e2 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f1/b3cd015900374c20adaa588e1d9906e2 2023-02-07 14:03:17,868 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1/9f9033ba05ac4e19806e5ebd7b369e11 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f1/9f9033ba05ac4e19806e5ebd7b369e11 2023-02-07 14:03:17,868 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1/19042036c746481fb4464227e5fbac07 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f1/19042036c746481fb4464227e5fbac07 2023-02-07 14:03:17,869 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1/569d1779835b4c6f9e623e7507ff742b to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f1/569d1779835b4c6f9e623e7507ff742b 2023-02-07 14:03:17,869 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/recovered.edits] 2023-02-07 14:03:17,869 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2/a0651377e9004ed99e6ad20d5723e839 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/f2/a0651377e9004ed99e6ad20d5723e839 2023-02-07 14:03:17,869 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2/82f167ac51414bd0aee6fc7f2cfba268 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2/82f167ac51414bd0aee6fc7f2cfba268 2023-02-07 14:03:17,872 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2/25ac6bea21c84f01b1c1a8d2585e60fb to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2/25ac6bea21c84f01b1c1a8d2585e60fb 2023-02-07 14:03:17,873 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2/88111b54bbdf4212a651b743d690da07 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/f2/88111b54bbdf4212a651b743d690da07 2023-02-07 14:03:17,874 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2/0716f7217e64439f8a49dc7a2dd96e22 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2/0716f7217e64439f8a49dc7a2dd96e22 2023-02-07 14:03:17,875 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2/6ee3ca2266ee44a8bf573fde5e4e2ad8 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2/6ee3ca2266ee44a8bf573fde5e4e2ad8 2023-02-07 14:03:17,875 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2/114841eba3da43d0835af7edc37a3434 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2/114841eba3da43d0835af7edc37a3434 2023-02-07 14:03:17,876 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2/f5b142508bcc43a19f61b7e3feb1b49d to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/f2/f5b142508bcc43a19f61b7e3feb1b49d 2023-02-07 14:03:17,877 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/recovered.edits/12.seqid to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b/recovered.edits/12.seqid 2023-02-07 14:03:17,877 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2/b12d2a47ba864732810a6f73d52468d3 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2/b12d2a47ba864732810a6f73d52468d3 2023-02-07 14:03:17,877 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2/564daf0b367f4fd096760ecf174bfb66 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/f2/564daf0b367f4fd096760ecf174bfb66 2023-02-07 14:03:17,878 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8cac1335a37cfd271778dece578dc88b 2023-02-07 14:03:17,878 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:17,878 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/recovered.edits/12.seqid to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8/recovered.edits/12.seqid 2023-02-07 14:03:17,878 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2/d4756733f56b4c53950e9e1092aac232 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/f2/d4756733f56b4c53950e9e1092aac232 2023-02-07 14:03:17,879 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1/052498e3e71b499fa32e97117a16cb76 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1/052498e3e71b499fa32e97117a16cb76 2023-02-07 14:03:17,879 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2/85fe7fe2f7314b77a7a1cc92507e7458 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/f2/85fe7fe2f7314b77a7a1cc92507e7458 2023-02-07 14:03:17,879 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/56002cf8b83f4276529438d13b773bb8 2023-02-07 14:03:17,881 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2/c8fc48ad53b1452e836a1d0c5ea1006f to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/f2/c8fc48ad53b1452e836a1d0c5ea1006f 2023-02-07 14:03:17,881 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1/79a7e5dcbc2a4cfc9b78a4d642931ac1 to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f1/79a7e5dcbc2a4cfc9b78a4d642931ac1 2023-02-07 14:03:17,882 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4/f1, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4/f2, FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4/recovered.edits] 2023-02-07 14:03:17,884 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/recovered.edits/12.seqid to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2/recovered.edits/12.seqid 2023-02-07 14:03:17,885 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/3d27aaddb20d932428863d8eda2399b2 2023-02-07 14:03:17,885 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/recovered.edits/12.seqid to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08/recovered.edits/12.seqid 2023-02-07 14:03:17,885 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/recovered.edits/12.seqid to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8/recovered.edits/12.seqid 2023-02-07 14:03:17,885 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/6a24f898703d5e53fde0a818f5deba08 2023-02-07 14:03:17,886 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/recovered.edits/12.seqid to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a/recovered.edits/12.seqid 2023-02-07 14:03:17,886 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2/2f35e7a04f2f41a59d69429a8833dbae to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2/2f35e7a04f2f41a59d69429a8833dbae 2023-02-07 14:03:17,886 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/8db3168d240af3f198f5e5aee2b07fe8 2023-02-07 14:03:17,887 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/cd032384c7aae39dc559f0ab4870f85a 2023-02-07 14:03:17,887 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/recovered.edits/12.seqid to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c/recovered.edits/12.seqid 2023-02-07 14:03:17,888 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/bc79e3a18b31e18d3202857c81987c1c 2023-02-07 14:03:17,888 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2/fc061ce0980f4017b9b281f3ed4aeb0a to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/f2/fc061ce0980f4017b9b281f3ed4aeb0a 2023-02-07 14:03:17,891 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4/recovered.edits/6.seqid to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4/recovered.edits/6.seqid 2023-02-07 14:03:17,891 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/7b537e9af0f831a97df0ff3a15af9fe4 2023-02-07 14:03:17,891 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/recovered.edits/12.seqid to hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/archive/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8/recovered.edits/12.seqid 2023-02-07 14:03:17,892 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/.tmp/data/default/testWithMockedMapReduceMultiRegion/1480baf3a921359925457313a52e67f8 2023-02-07 14:03:17,892 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-07 14:03:17,894 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:17,897 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-07 14:03:17,900 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-07 14:03:17,901 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:17,901 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-07 14:03:17,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778597902"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:17,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778597902"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:17,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778597902"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:17,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778597902"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:17,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778597902"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:17,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778597902"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:17,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778597902"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:17,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778597902"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:17,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778597902"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:17,902 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778597902"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:17,904 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-07 14:03:17,904 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 817b819a97bae6e7ccdc3339bba18bec, NAME => 'testWithMockedMapReduceMultiRegion,,1675778594122.817b819a97bae6e7ccdc3339bba18bec.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 8db3168d240af3f198f5e5aee2b07fe8, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1675778594122.8db3168d240af3f198f5e5aee2b07fe8.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 6a24f898703d5e53fde0a818f5deba08, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1675778594122.6a24f898703d5e53fde0a818f5deba08.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => bc79e3a18b31e18d3202857c81987c1c, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1675778594122.bc79e3a18b31e18d3202857c81987c1c.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => cd032384c7aae39dc559f0ab4870f85a, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1675778594122.cd032384c7aae39dc559f0ab4870f85a.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 3d27aaddb20d932428863d8eda2399b2, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1675778594122.3d27aaddb20d932428863d8eda2399b2.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 8cac1335a37cfd271778dece578dc88b, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1675778594122.8cac1335a37cfd271778dece578dc88b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 56002cf8b83f4276529438d13b773bb8, NAME => 'testWithMockedMapReduceMultiRegion,t43,1675778594122.56002cf8b83f4276529438d13b773bb8.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 1480baf3a921359925457313a52e67f8, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1675778594122.1480baf3a921359925457313a52e67f8.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 7b537e9af0f831a97df0ff3a15af9fe4, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1675778594122.7b537e9af0f831a97df0ff3a15af9fe4.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-07 14:03:17,904 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-07 14:03:17,904 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675778597904"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:17,905 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-07 14:03:17,907 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-07 14:03:17,908 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 75 msec 2023-02-07 14:03:17,936 INFO [Listener at localhost/45865] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:17,936 INFO [Listener at localhost/45865] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:17,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37885] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-07 14:03:17,937 INFO [Listener at localhost/45865] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-07 14:03:17,937 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 14:03:17,937 INFO [Listener at localhost/45865] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 14:03:17,937 DEBUG [Listener at localhost/45865] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49122599 to 127.0.0.1:61542 2023-02-07 14:03:17,938 DEBUG [Listener at localhost/45865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:17,938 DEBUG [Listener at localhost/45865] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 14:03:17,938 DEBUG [Listener at localhost/45865] util.JVMClusterUtil(257): Found active master hash=1214557593, stopped=false 2023-02-07 14:03:17,938 INFO [Listener at localhost/45865] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37885,1675778592755 2023-02-07 14:03:17,941 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:17,941 INFO [Listener at localhost/45865] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 14:03:17,941 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:17,941 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:17,943 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:17,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:17,943 DEBUG [Listener at localhost/45865] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e53f994 to 127.0.0.1:61542 2023-02-07 14:03:17,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:17,943 DEBUG [Listener at localhost/45865] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:17,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:17,943 INFO [Listener at localhost/45865] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44239,1675778592805' ***** 2023-02-07 14:03:17,943 INFO [Listener at localhost/45865] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:03:17,944 INFO [Listener at localhost/45865] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45365,1675778592875' ***** 2023-02-07 14:03:17,944 INFO [Listener at localhost/45865] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:03:17,944 INFO [RS:0;jenkins-hbase4:44239] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:03:17,944 INFO [RS:1;jenkins-hbase4:45365] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:03:17,944 INFO [RS:0;jenkins-hbase4:44239] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:03:17,944 INFO [RS:1;jenkins-hbase4:45365] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:03:17,944 INFO [RS:0;jenkins-hbase4:44239] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:03:17,944 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:03:17,944 INFO [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:17,944 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:03:17,944 INFO [RS:1;jenkins-hbase4:45365] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:03:17,946 DEBUG [RS:0;jenkins-hbase4:44239] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43248399 to 127.0.0.1:61542 2023-02-07 14:03:17,947 INFO [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(3304): Received CLOSE for d0f8dcc1231b534c2c3ae41c805f78db 2023-02-07 14:03:17,947 DEBUG [RS:0;jenkins-hbase4:44239] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:17,947 INFO [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:17,947 INFO [RS:0;jenkins-hbase4:44239] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:03:17,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d0f8dcc1231b534c2c3ae41c805f78db, disabling compactions & flushes 2023-02-07 14:03:17,947 DEBUG [RS:1;jenkins-hbase4:45365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x185fde6c to 127.0.0.1:61542 2023-02-07 14:03:17,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. 2023-02-07 14:03:17,947 INFO [RS:0;jenkins-hbase4:44239] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:03:17,948 INFO [RS:0;jenkins-hbase4:44239] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:03:17,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. 2023-02-07 14:03:17,948 DEBUG [RS:1;jenkins-hbase4:45365] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:17,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. after waiting 0 ms 2023-02-07 14:03:17,948 INFO [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 14:03:17,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. 2023-02-07 14:03:17,948 INFO [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 14:03:17,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing d0f8dcc1231b534c2c3ae41c805f78db 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 14:03:17,948 INFO [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 14:03:17,948 DEBUG [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-07 14:03:17,948 DEBUG [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(1479): Online Regions={d0f8dcc1231b534c2c3ae41c805f78db=hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db.} 2023-02-07 14:03:17,950 DEBUG [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 14:03:17,950 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:03:17,950 DEBUG [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(1505): Waiting on d0f8dcc1231b534c2c3ae41c805f78db 2023-02-07 14:03:17,950 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:03:17,950 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:03:17,950 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:03:17,951 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:03:17,951 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-07 14:03:17,951 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:17,952 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:17,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/namespace/d0f8dcc1231b534c2c3ae41c805f78db/.tmp/info/7a0034be7b9341ddbec405590b21d841 2023-02-07 14:03:17,966 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/.tmp/info/ea7e665d5fe14d4092f9bea7be3cb5c1 2023-02-07 14:03:17,970 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea7e665d5fe14d4092f9bea7be3cb5c1 2023-02-07 14:03:17,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/namespace/d0f8dcc1231b534c2c3ae41c805f78db/.tmp/info/7a0034be7b9341ddbec405590b21d841 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/namespace/d0f8dcc1231b534c2c3ae41c805f78db/info/7a0034be7b9341ddbec405590b21d841 2023-02-07 14:03:17,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/namespace/d0f8dcc1231b534c2c3ae41c805f78db/info/7a0034be7b9341ddbec405590b21d841, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 14:03:17,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d0f8dcc1231b534c2c3ae41c805f78db in 28ms, sequenceid=6, compaction requested=false 2023-02-07 14:03:17,983 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/.tmp/rep_barrier/6ff0981c33344a069b39fd564548c5ff 2023-02-07 14:03:17,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/namespace/d0f8dcc1231b534c2c3ae41c805f78db/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 14:03:17,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. 2023-02-07 14:03:17,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d0f8dcc1231b534c2c3ae41c805f78db: Waiting for close lock at 1675778597947Running coprocessor pre-close hooks at 1675778597947Disabling compacts and flushes for region at 1675778597947Disabling writes for close at 1675778597948 (+1 ms)Obtaining lock to block concurrent updates at 1675778597948Preparing flush snapshotting stores in d0f8dcc1231b534c2c3ae41c805f78db at 1675778597948Finished memstore snapshotting hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675778597950 (+2 ms)Flushing stores of hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. at 1675778597951 (+1 ms)Flushing d0f8dcc1231b534c2c3ae41c805f78db/info: creating writer at 1675778597951Flushing d0f8dcc1231b534c2c3ae41c805f78db/info: appending metadata at 1675778597955 (+4 ms)Flushing d0f8dcc1231b534c2c3ae41c805f78db/info: closing flushed file at 1675778597955Flushing d0f8dcc1231b534c2c3ae41c805f78db/info: reopening flushed file at 1675778597971 (+16 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for d0f8dcc1231b534c2c3ae41c805f78db in 28ms, sequenceid=6, compaction requested=false at 1675778597976 (+5 ms)Writing region close event to WAL at 1675778597977 (+1 ms)Running coprocessor post-close hooks at 1675778597985 (+8 ms)Closed at 1675778597986 (+1 ms) 2023-02-07 14:03:17,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675778593448.d0f8dcc1231b534c2c3ae41c805f78db. 2023-02-07 14:03:17,988 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ff0981c33344a069b39fd564548c5ff 2023-02-07 14:03:18,002 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/.tmp/table/671c984f425e48bf94a5d97cbe1def7d 2023-02-07 14:03:18,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 671c984f425e48bf94a5d97cbe1def7d 2023-02-07 14:03:18,006 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/.tmp/info/ea7e665d5fe14d4092f9bea7be3cb5c1 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/info/ea7e665d5fe14d4092f9bea7be3cb5c1 2023-02-07 14:03:18,010 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ea7e665d5fe14d4092f9bea7be3cb5c1 2023-02-07 14:03:18,010 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/info/ea7e665d5fe14d4092f9bea7be3cb5c1, entries=30, sequenceid=57, filesize=8.3 K 2023-02-07 14:03:18,010 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/.tmp/rep_barrier/6ff0981c33344a069b39fd564548c5ff as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/rep_barrier/6ff0981c33344a069b39fd564548c5ff 2023-02-07 14:03:18,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ff0981c33344a069b39fd564548c5ff 2023-02-07 14:03:18,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/rep_barrier/6ff0981c33344a069b39fd564548c5ff, entries=10, sequenceid=57, filesize=6.1 K 2023-02-07 14:03:18,015 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/.tmp/table/671c984f425e48bf94a5d97cbe1def7d as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/table/671c984f425e48bf94a5d97cbe1def7d 2023-02-07 14:03:18,018 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 671c984f425e48bf94a5d97cbe1def7d 2023-02-07 14:03:18,019 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/table/671c984f425e48bf94a5d97cbe1def7d, entries=13, sequenceid=57, filesize=6.1 K 2023-02-07 14:03:18,019 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=57, compaction requested=false 2023-02-07 14:03:18,023 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-07 14:03:18,023 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 14:03:18,024 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:18,024 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778597948Running coprocessor pre-close hooks at 1675778597948Disabling compacts and flushes for region at 1675778597948Disabling writes for close at 1675778597951 (+3 ms)Obtaining lock to block concurrent updates at 1675778597951Preparing flush snapshotting stores in 1588230740 at 1675778597951Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1675778597951Flushing stores of hbase:meta,,1.1588230740 at 1675778597951Flushing 1588230740/info: creating writer at 1675778597951Flushing 1588230740/info: appending metadata at 1675778597956 (+5 ms)Flushing 1588230740/info: closing flushed file at 1675778597956Flushing 1588230740/rep_barrier: creating writer at 1675778597970 (+14 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675778597973 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675778597973Flushing 1588230740/table: creating writer at 1675778597988 (+15 ms)Flushing 1588230740/table: appending metadata at 1675778597990 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675778597990Flushing 1588230740/info: reopening flushed file at 1675778598007 (+17 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675778598011 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675778598015 (+4 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=57, compaction requested=false at 1675778598019 (+4 ms)Writing region close event to WAL at 1675778598020 (+1 ms)Running coprocessor post-close hooks at 1675778598023 (+3 ms)Closed at 1675778598024 (+1 ms) 2023-02-07 14:03:18,024 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:18,147 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-07 14:03:18,148 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-07 14:03:18,150 INFO [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44239,1675778592805; all regions closed. 2023-02-07 14:03:18,150 INFO [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45365,1675778592875; all regions closed. 2023-02-07 14:03:18,157 DEBUG [RS:0;jenkins-hbase4:44239] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/oldWALs 2023-02-07 14:03:18,157 INFO [RS:0;jenkins-hbase4:44239] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44239%2C1675778592805.meta:.meta(num 1675778593396) 2023-02-07 14:03:18,157 DEBUG [RS:1;jenkins-hbase4:45365] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/oldWALs 2023-02-07 14:03:18,157 INFO [RS:1;jenkins-hbase4:45365] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45365%2C1675778592875:(num 1675778593813) 2023-02-07 14:03:18,157 DEBUG [RS:1;jenkins-hbase4:45365] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:18,157 INFO [RS:1;jenkins-hbase4:45365] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:18,158 INFO [RS:1;jenkins-hbase4:45365] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 14:03:18,158 INFO [RS:1;jenkins-hbase4:45365] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:03:18,158 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:18,158 INFO [RS:1;jenkins-hbase4:45365] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:03:18,158 INFO [RS:1;jenkins-hbase4:45365] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:03:18,159 INFO [RS:1;jenkins-hbase4:45365] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45365 2023-02-07 14:03:18,161 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:18,161 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:18,161 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:18,161 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45365,1675778592875 2023-02-07 14:03:18,161 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:18,161 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45365,1675778592875] 2023-02-07 14:03:18,161 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45365,1675778592875; numProcessing=1 2023-02-07 14:03:18,163 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45365,1675778592875 already deleted, retry=false 2023-02-07 14:03:18,163 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45365,1675778592875 expired; onlineServers=1 2023-02-07 14:03:18,163 DEBUG [RS:0;jenkins-hbase4:44239] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/oldWALs 2023-02-07 14:03:18,163 INFO [RS:0;jenkins-hbase4:44239] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44239%2C1675778592805:(num 1675778594187) 2023-02-07 14:03:18,163 DEBUG [RS:0;jenkins-hbase4:44239] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:18,163 INFO [RS:0;jenkins-hbase4:44239] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:18,163 INFO [RS:0;jenkins-hbase4:44239] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 14:03:18,163 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:18,164 INFO [RS:0;jenkins-hbase4:44239] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44239 2023-02-07 14:03:18,167 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44239,1675778592805 2023-02-07 14:03:18,167 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:18,167 ERROR [Listener at localhost/45865-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1fa5347a rejected from java.util.concurrent.ThreadPoolExecutor@1b9ab356[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:18,168 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44239,1675778592805] 2023-02-07 14:03:18,168 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44239,1675778592805; numProcessing=2 2023-02-07 14:03:18,169 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44239,1675778592805 already deleted, retry=false 2023-02-07 14:03:18,169 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44239,1675778592805 expired; onlineServers=0 2023-02-07 14:03:18,169 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37885,1675778592755' ***** 2023-02-07 14:03:18,169 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 14:03:18,170 DEBUG [M:0;jenkins-hbase4:37885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c5b304d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:18,170 INFO [M:0;jenkins-hbase4:37885] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37885,1675778592755 2023-02-07 14:03:18,170 INFO [M:0;jenkins-hbase4:37885] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37885,1675778592755; all regions closed. 2023-02-07 14:03:18,170 DEBUG [M:0;jenkins-hbase4:37885] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:18,170 DEBUG [M:0;jenkins-hbase4:37885] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 14:03:18,170 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 14:03:18,170 DEBUG [M:0;jenkins-hbase4:37885] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 14:03:18,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778593044] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778593044,5,FailOnTimeoutGroup] 2023-02-07 14:03:18,170 INFO [M:0;jenkins-hbase4:37885] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 14:03:18,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778593044] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778593044,5,FailOnTimeoutGroup] 2023-02-07 14:03:18,171 INFO [M:0;jenkins-hbase4:37885] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 14:03:18,172 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:18,172 INFO [M:0;jenkins-hbase4:37885] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 14:03:18,172 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:18,172 DEBUG [M:0;jenkins-hbase4:37885] master.HMaster(1502): Stopping service threads 2023-02-07 14:03:18,172 INFO [M:0;jenkins-hbase4:37885] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 14:03:18,172 ERROR [M:0;jenkins-hbase4:37885] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 14:03:18,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:18,172 INFO [M:0;jenkins-hbase4:37885] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 14:03:18,173 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 14:03:18,173 DEBUG [M:0;jenkins-hbase4:37885] zookeeper.ZKUtil(398): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 14:03:18,173 WARN [M:0;jenkins-hbase4:37885] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 14:03:18,173 INFO [M:0;jenkins-hbase4:37885] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 14:03:18,173 INFO [M:0;jenkins-hbase4:37885] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 14:03:18,173 DEBUG [M:0;jenkins-hbase4:37885] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:03:18,174 INFO [M:0;jenkins-hbase4:37885] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:18,174 DEBUG [M:0;jenkins-hbase4:37885] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:18,174 DEBUG [M:0;jenkins-hbase4:37885] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:03:18,174 DEBUG [M:0;jenkins-hbase4:37885] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:18,174 INFO [M:0;jenkins-hbase4:37885] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.14 KB heapSize=200.04 KB 2023-02-07 14:03:18,183 INFO [M:0;jenkins-hbase4:37885] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.14 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8439e4a38b294436adcba7820b49bed4 2023-02-07 14:03:18,187 DEBUG [M:0;jenkins-hbase4:37885] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8439e4a38b294436adcba7820b49bed4 as hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8439e4a38b294436adcba7820b49bed4 2023-02-07 14:03:18,191 INFO [M:0;jenkins-hbase4:37885] regionserver.HStore(1080): Added hdfs://localhost:38577/user/jenkins/test-data/27d93a6b-d6d4-c148-5747-111f4d605a97/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8439e4a38b294436adcba7820b49bed4, entries=53, sequenceid=357, filesize=10.7 K 2023-02-07 14:03:18,192 INFO [M:0;jenkins-hbase4:37885] regionserver.HRegion(2947): Finished flush of dataSize ~167.14 KB/171153, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=357, compaction requested=false 2023-02-07 14:03:18,192 INFO [M:0;jenkins-hbase4:37885] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:18,192 DEBUG [M:0;jenkins-hbase4:37885] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778598173Disabling compacts and flushes for region at 1675778598173Disabling writes for close at 1675778598174 (+1 ms)Obtaining lock to block concurrent updates at 1675778598174Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675778598174Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171153, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1675778598174Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675778598175 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675778598175Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675778598177 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675778598177Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675778598188 (+11 ms)Finished flush of dataSize ~167.14 KB/171153, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=357, compaction requested=false at 1675778598192 (+4 ms)Writing region close event to WAL at 1675778598192Closed at 1675778598192 2023-02-07 14:03:18,195 INFO [M:0;jenkins-hbase4:37885] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 14:03:18,195 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:18,196 INFO [M:0;jenkins-hbase4:37885] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37885 2023-02-07 14:03:18,208 DEBUG [M:0;jenkins-hbase4:37885] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37885,1675778592755 already deleted, retry=false 2023-02-07 14:03:18,445 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:18,445 INFO [M:0;jenkins-hbase4:37885] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37885,1675778592755; zookeeper connection closed. 2023-02-07 14:03:18,446 ERROR [Listener at localhost/45865-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4fd3b347 rejected from java.util.concurrent.ThreadPoolExecutor@4bec2e65[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:18,446 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): master:37885-0x1002f17f9a50000, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:18,447 ERROR [Listener at localhost/45865-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d317959 rejected from java.util.concurrent.ThreadPoolExecutor@4bec2e65[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:18,546 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:18,546 INFO [RS:0;jenkins-hbase4:44239] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44239,1675778592805; zookeeper connection closed. 2023-02-07 14:03:18,546 ERROR [Listener at localhost/45865-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@59bc7e5c rejected from java.util.concurrent.ThreadPoolExecutor@1b9ab356[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:18,546 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4c265a9a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4c265a9a 2023-02-07 14:03:18,546 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:44239-0x1002f17f9a50001, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:18,546 ERROR [Listener at localhost/45865-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@21429951 rejected from java.util.concurrent.ThreadPoolExecutor@1b9ab356[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:18,646 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:18,646 INFO [RS:1;jenkins-hbase4:45365] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45365,1675778592875; zookeeper connection closed. 2023-02-07 14:03:18,646 ERROR [Listener at localhost/45865-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@228daab2 rejected from java.util.concurrent.ThreadPoolExecutor@26b23a3b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:18,646 DEBUG [Listener at localhost/45865-EventThread] zookeeper.ZKWatcher(600): regionserver:45365-0x1002f17f9a50002, quorum=127.0.0.1:61542, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:18,646 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1914ebd6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1914ebd6 2023-02-07 14:03:18,646 ERROR [Listener at localhost/45865-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1d0e75bd rejected from java.util.concurrent.ThreadPoolExecutor@26b23a3b[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:18,646 INFO [Listener at localhost/45865] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 14:03:18,647 WARN [Listener at localhost/45865] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:03:18,650 INFO [Listener at localhost/45865] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:18,719 WARN [BP-1728077947-172.31.14.131-1675778592160 heartbeating to localhost/127.0.0.1:38577] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1728077947-172.31.14.131-1675778592160 (Datanode Uuid 54aeb1ed-34b4-48e6-a328-121735ad143e) service to localhost/127.0.0.1:38577 2023-02-07 14:03:18,720 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/cluster_0b7b8ea2-5371-3e0e-a08a-41ba9695617d/dfs/data/data3/current/BP-1728077947-172.31.14.131-1675778592160] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:18,720 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/cluster_0b7b8ea2-5371-3e0e-a08a-41ba9695617d/dfs/data/data4/current/BP-1728077947-172.31.14.131-1675778592160] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:18,761 WARN [Listener at localhost/45865] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:03:18,765 INFO [Listener at localhost/45865] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:18,869 WARN [BP-1728077947-172.31.14.131-1675778592160 heartbeating to localhost/127.0.0.1:38577] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 14:03:18,871 WARN [BP-1728077947-172.31.14.131-1675778592160 heartbeating to localhost/127.0.0.1:38577] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1728077947-172.31.14.131-1675778592160 (Datanode Uuid 63df5d2e-ebb0-4d5a-80e4-fc20171a3e97) service to localhost/127.0.0.1:38577 2023-02-07 14:03:18,872 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/cluster_0b7b8ea2-5371-3e0e-a08a-41ba9695617d/dfs/data/data1/current/BP-1728077947-172.31.14.131-1675778592160] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:18,873 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/cluster_0b7b8ea2-5371-3e0e-a08a-41ba9695617d/dfs/data/data2/current/BP-1728077947-172.31.14.131-1675778592160] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:18,882 INFO [Listener at localhost/45865] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:19,001 INFO [Listener at localhost/45865] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 14:03:19,036 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 14:03:19,052 INFO [Listener at localhost/45865] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=227 (was 178) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45865.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45865.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/45865.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:38577 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:38577 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:38577 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45865.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45865.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45865.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45865.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:38577 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/45865 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,37885,1675778592755)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45865.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:38577 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45865.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45865.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:38577 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38577 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=638 (was 568) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=279 (was 260) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=5446 (was 5498) 2023-02-07 14:03:19,063 INFO [Listener at localhost/45865] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=227, OpenFileDescriptor=638, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=166, AvailableMemoryMB=5446 2023-02-07 14:03:19,073 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/hadoop.log.dir so I do NOT create it in target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde 2023-02-07 14:03:19,073 WARN [Listener at localhost/45865] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 14:03:19,073 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/hadoop.tmp.dir so I do NOT create it in target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde 2023-02-07 14:03:19,073 WARN [Listener at localhost/45865] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e9df7d6e-c946-8b4f-f447-7c5a5d088fb3/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 14:03:19,073 DEBUG [Listener at localhost/45865] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde 2023-02-07 14:03:19,074 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 14:03:19,074 INFO [Listener at localhost/45865] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/cluster_857b5c2f-41cd-2870-638e-a1540db27280, deleteOnExit=true 2023-02-07 14:03:19,074 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 14:03:19,074 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/test.cache.data in system properties and HBase conf 2023-02-07 14:03:19,074 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 14:03:19,074 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/hadoop.log.dir in system properties and HBase conf 2023-02-07 14:03:19,074 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 14:03:19,074 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 14:03:19,074 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 14:03:19,074 DEBUG [Listener at localhost/45865] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 14:03:19,075 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:03:19,075 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:03:19,075 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 14:03:19,075 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:03:19,075 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 14:03:19,075 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 14:03:19,075 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:03:19,075 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:03:19,075 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 14:03:19,075 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/nfs.dump.dir in system properties and HBase conf 2023-02-07 14:03:19,075 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/java.io.tmpdir in system properties and HBase conf 2023-02-07 14:03:19,076 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:03:19,076 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 14:03:19,076 INFO [Listener at localhost/45865] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 14:03:19,080 WARN [Listener at localhost/45865] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:03:19,080 WARN [Listener at localhost/45865] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:03:19,119 WARN [Listener at localhost/45865] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-07 14:03:19,194 WARN [Listener at localhost/45865] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:19,196 INFO [Listener at localhost/45865] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:19,202 INFO [Listener at localhost/45865] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/java.io.tmpdir/Jetty_localhost_38629_hdfs____.w74o2m/webapp 2023-02-07 14:03:19,293 INFO [Listener at localhost/45865] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38629 2023-02-07 14:03:19,298 WARN [Listener at localhost/45865] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:03:19,299 WARN [Listener at localhost/45865] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:03:19,338 WARN [Listener at localhost/45431] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:19,357 WARN [Listener at localhost/45431] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:03:19,359 WARN [Listener at localhost/45431] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:19,360 INFO [Listener at localhost/45431] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:19,370 INFO [Listener at localhost/45431] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/java.io.tmpdir/Jetty_localhost_37029_datanode____dbnr3u/webapp 2023-02-07 14:03:19,462 INFO [Listener at localhost/45431] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37029 2023-02-07 14:03:19,469 WARN [Listener at localhost/35915] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:19,482 WARN [Listener at localhost/35915] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:03:19,484 WARN [Listener at localhost/35915] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:19,485 INFO [Listener at localhost/35915] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:19,488 INFO [Listener at localhost/35915] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/java.io.tmpdir/Jetty_localhost_45987_datanode____nfde0u/webapp 2023-02-07 14:03:19,564 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x414fb713f2940afb: Processing first storage report for DS-d37c5e2b-15ee-4bdd-9973-2a68b09e73c2 from datanode 9dbc8763-725c-4ad0-bf10-c944f1a09347 2023-02-07 14:03:19,564 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x414fb713f2940afb: from storage DS-d37c5e2b-15ee-4bdd-9973-2a68b09e73c2 node DatanodeRegistration(127.0.0.1:46789, datanodeUuid=9dbc8763-725c-4ad0-bf10-c944f1a09347, infoPort=42743, infoSecurePort=0, ipcPort=35915, storageInfo=lv=-57;cid=testClusterID;nsid=580249409;c=1675778599082), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-07 14:03:19,564 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x414fb713f2940afb: Processing first storage report for DS-895b25d4-11ba-4d6f-9171-cd49cc239744 from datanode 9dbc8763-725c-4ad0-bf10-c944f1a09347 2023-02-07 14:03:19,564 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x414fb713f2940afb: from storage DS-895b25d4-11ba-4d6f-9171-cd49cc239744 node DatanodeRegistration(127.0.0.1:46789, datanodeUuid=9dbc8763-725c-4ad0-bf10-c944f1a09347, infoPort=42743, infoSecurePort=0, ipcPort=35915, storageInfo=lv=-57;cid=testClusterID;nsid=580249409;c=1675778599082), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:19,583 INFO [Listener at localhost/35915] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45987 2023-02-07 14:03:19,589 WARN [Listener at localhost/43889] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:19,683 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8bc983de39a6cf3e: Processing first storage report for DS-790aa020-35c7-4c93-af42-83a1b13e3f1b from datanode 3a943684-6292-46d9-8345-f98f509acf16 2023-02-07 14:03:19,683 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8bc983de39a6cf3e: from storage DS-790aa020-35c7-4c93-af42-83a1b13e3f1b node DatanodeRegistration(127.0.0.1:39647, datanodeUuid=3a943684-6292-46d9-8345-f98f509acf16, infoPort=33365, infoSecurePort=0, ipcPort=43889, storageInfo=lv=-57;cid=testClusterID;nsid=580249409;c=1675778599082), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:19,684 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8bc983de39a6cf3e: Processing first storage report for DS-d80930bb-26fd-4c50-a25d-7868ac3797ff from datanode 3a943684-6292-46d9-8345-f98f509acf16 2023-02-07 14:03:19,684 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8bc983de39a6cf3e: from storage DS-d80930bb-26fd-4c50-a25d-7868ac3797ff node DatanodeRegistration(127.0.0.1:39647, datanodeUuid=3a943684-6292-46d9-8345-f98f509acf16, infoPort=33365, infoSecurePort=0, ipcPort=43889, storageInfo=lv=-57;cid=testClusterID;nsid=580249409;c=1675778599082), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:19,697 DEBUG [Listener at localhost/43889] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde 2023-02-07 14:03:19,699 INFO [Listener at localhost/43889] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/cluster_857b5c2f-41cd-2870-638e-a1540db27280/zookeeper_0, clientPort=50760, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/cluster_857b5c2f-41cd-2870-638e-a1540db27280/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/cluster_857b5c2f-41cd-2870-638e-a1540db27280/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 14:03:19,699 INFO [Listener at localhost/43889] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50760 2023-02-07 14:03:19,700 INFO [Listener at localhost/43889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:19,700 INFO [Listener at localhost/43889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:19,713 INFO [Listener at localhost/43889] util.FSUtils(479): Created version file at hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c with version=8 2023-02-07 14:03:19,713 INFO [Listener at localhost/43889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:19,714 INFO [Listener at localhost/43889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:19,714 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45431/user/jenkins/test-data/d706f73a-724b-e0fd-b819-71e9933e9c6c/hbase-staging 2023-02-07 14:03:19,716 INFO [Listener at localhost/43889] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:19,716 INFO [Listener at localhost/43889] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:19,716 INFO [Listener at localhost/43889] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:19,716 INFO [Listener at localhost/43889] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:19,717 INFO [Listener at localhost/43889] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:19,717 INFO [Listener at localhost/43889] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:19,717 INFO [Listener at localhost/43889] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:19,718 INFO [Listener at localhost/43889] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32847 2023-02-07 14:03:19,718 INFO [Listener at localhost/43889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:19,719 INFO [Listener at localhost/43889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:19,719 INFO [Listener at localhost/43889] zookeeper.RecoverableZooKeeper(93): Process identifier=master:32847 connecting to ZooKeeper ensemble=127.0.0.1:50760 2023-02-07 14:03:19,727 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:328470x0, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:19,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:32847-0x1002f1814d70000 connected 2023-02-07 14:03:19,744 DEBUG [Listener at localhost/43889] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:19,744 DEBUG [Listener at localhost/43889] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:19,744 DEBUG [Listener at localhost/43889] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:19,748 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32847 2023-02-07 14:03:19,748 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32847 2023-02-07 14:03:19,748 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32847 2023-02-07 14:03:19,751 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32847 2023-02-07 14:03:19,752 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32847 2023-02-07 14:03:19,752 INFO [Listener at localhost/43889] master.HMaster(439): hbase.rootdir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c, hbase.cluster.distributed=false 2023-02-07 14:03:19,766 INFO [Listener at localhost/43889] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:19,766 INFO [Listener at localhost/43889] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:19,766 INFO [Listener at localhost/43889] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:19,767 INFO [Listener at localhost/43889] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:19,767 INFO [Listener at localhost/43889] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:19,767 INFO [Listener at localhost/43889] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:19,767 INFO [Listener at localhost/43889] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:19,768 INFO [Listener at localhost/43889] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40925 2023-02-07 14:03:19,768 INFO [Listener at localhost/43889] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:03:19,771 DEBUG [Listener at localhost/43889] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:19,771 INFO [Listener at localhost/43889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:19,772 INFO [Listener at localhost/43889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:19,773 INFO [Listener at localhost/43889] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40925 connecting to ZooKeeper ensemble=127.0.0.1:50760 2023-02-07 14:03:19,776 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:409250x0, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:19,777 DEBUG [Listener at localhost/43889] zookeeper.ZKUtil(164): regionserver:409250x0, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:19,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40925-0x1002f1814d70001 connected 2023-02-07 14:03:19,778 DEBUG [Listener at localhost/43889] zookeeper.ZKUtil(164): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:19,779 DEBUG [Listener at localhost/43889] zookeeper.ZKUtil(164): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:19,779 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40925 2023-02-07 14:03:19,780 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40925 2023-02-07 14:03:19,780 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40925 2023-02-07 14:03:19,781 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40925 2023-02-07 14:03:19,782 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40925 2023-02-07 14:03:19,792 INFO [Listener at localhost/43889] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:19,792 INFO [Listener at localhost/43889] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:19,793 INFO [Listener at localhost/43889] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:19,793 INFO [Listener at localhost/43889] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:19,793 INFO [Listener at localhost/43889] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:19,793 INFO [Listener at localhost/43889] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:19,793 INFO [Listener at localhost/43889] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:19,794 INFO [Listener at localhost/43889] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42829 2023-02-07 14:03:19,794 INFO [Listener at localhost/43889] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:03:19,796 DEBUG [Listener at localhost/43889] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:19,796 INFO [Listener at localhost/43889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:19,797 INFO [Listener at localhost/43889] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:19,798 INFO [Listener at localhost/43889] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42829 connecting to ZooKeeper ensemble=127.0.0.1:50760 2023-02-07 14:03:19,802 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:428290x0, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:19,803 DEBUG [Listener at localhost/43889] zookeeper.ZKUtil(164): regionserver:428290x0, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:19,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42829-0x1002f1814d70002 connected 2023-02-07 14:03:19,804 DEBUG [Listener at localhost/43889] zookeeper.ZKUtil(164): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:19,804 DEBUG [Listener at localhost/43889] zookeeper.ZKUtil(164): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:19,808 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42829 2023-02-07 14:03:19,808 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42829 2023-02-07 14:03:19,808 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42829 2023-02-07 14:03:19,809 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42829 2023-02-07 14:03:19,809 DEBUG [Listener at localhost/43889] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42829 2023-02-07 14:03:19,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,32847,1675778599716 2023-02-07 14:03:19,812 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:03:19,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,32847,1675778599716 2023-02-07 14:03:19,815 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:19,815 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:19,815 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:19,815 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:19,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:03:19,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:03:19,819 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,32847,1675778599716 from backup master directory 2023-02-07 14:03:19,820 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,32847,1675778599716 2023-02-07 14:03:19,820 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:03:19,820 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:19,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,32847,1675778599716 2023-02-07 14:03:19,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/hbase.id with ID: 285394b0-8aea-409f-89f8-62859ebd44cd 2023-02-07 14:03:19,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:19,841 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:19,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5d2fdca9 to 127.0.0.1:50760 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:19,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8655e1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:19,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:19,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 14:03:19,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:19,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/MasterData/data/master/store-tmp 2023-02-07 14:03:19,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:19,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:03:19,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:19,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:19,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:03:19,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:19,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:19,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778599870Disabling compacts and flushes for region at 1675778599870Disabling writes for close at 1675778599870Writing region close event to WAL at 1675778599870Closed at 1675778599870 2023-02-07 14:03:19,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/MasterData/WALs/jenkins-hbase4.apache.org,32847,1675778599716 2023-02-07 14:03:19,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32847%2C1675778599716, suffix=, logDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/MasterData/WALs/jenkins-hbase4.apache.org,32847,1675778599716, archiveDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/MasterData/oldWALs, maxLogs=10 2023-02-07 14:03:19,887 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46789,DS-d37c5e2b-15ee-4bdd-9973-2a68b09e73c2,DISK] 2023-02-07 14:03:19,887 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39647,DS-790aa020-35c7-4c93-af42-83a1b13e3f1b,DISK] 2023-02-07 14:03:19,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/MasterData/WALs/jenkins-hbase4.apache.org,32847,1675778599716/jenkins-hbase4.apache.org%2C32847%2C1675778599716.1675778599872 2023-02-07 14:03:19,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39647,DS-790aa020-35c7-4c93-af42-83a1b13e3f1b,DISK], DatanodeInfoWithStorage[127.0.0.1:46789,DS-d37c5e2b-15ee-4bdd-9973-2a68b09e73c2,DISK]] 2023-02-07 14:03:19,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:19,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:19,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:19,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:19,890 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:19,891 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 14:03:19,891 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 14:03:19,892 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:19,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:19,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:19,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:19,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:19,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65026437, jitterRate=-0.031030580401420593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:03:19,897 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675778599889Initializing all the Stores at 1675778599890 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778599890Cleaning up temporary data from old regions at 1675778599893 (+3 ms)Cleaning up detritus from prior splits at 1675778599893Region opened successfully at 1675778599897 (+4 ms) 2023-02-07 14:03:19,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 14:03:19,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 14:03:19,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 14:03:19,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 14:03:19,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 14:03:19,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 14:03:19,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 14:03:19,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 14:03:19,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 14:03:19,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 14:03:19,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 14:03:19,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 14:03:19,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 14:03:19,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 14:03:19,913 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:19,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 14:03:19,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 14:03:19,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 14:03:19,916 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:19,916 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:19,916 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:19,916 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:19,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,32847,1675778599716, sessionid=0x1002f1814d70000, setting cluster-up flag (Was=false) 2023-02-07 14:03:19,922 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:19,928 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 14:03:19,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,32847,1675778599716 2023-02-07 14:03:19,932 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:19,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 14:03:19,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,32847,1675778599716 2023-02-07 14:03:19,936 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.hbase-snapshot/.tmp 2023-02-07 14:03:19,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:19,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:19,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:19,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:19,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:19,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 14:03:19,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:19,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:19,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:19,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675778629939 2023-02-07 14:03:19,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 14:03:19,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 14:03:19,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 14:03:19,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 14:03:19,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 14:03:19,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 14:03:19,940 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:19,940 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 14:03:19,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:19,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 14:03:19,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 14:03:19,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 14:03:19,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 14:03:19,941 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:19,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 14:03:19,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778599942,5,FailOnTimeoutGroup] 2023-02-07 14:03:19,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778599942,5,FailOnTimeoutGroup] 2023-02-07 14:03:19,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:19,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 14:03:19,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:19,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:19,953 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:19,954 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:19,954 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c 2023-02-07 14:03:19,962 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:19,963 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:03:19,964 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/info 2023-02-07 14:03:19,965 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:03:19,965 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:19,965 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:03:19,966 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:19,966 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:03:19,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:19,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:03:19,968 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/table 2023-02-07 14:03:19,968 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:03:19,968 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:19,969 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740 2023-02-07 14:03:19,969 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740 2023-02-07 14:03:19,971 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:03:19,972 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:03:19,973 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:19,973 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68214366, jitterRate=0.01647326350212097}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:03:19,974 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675778599963Initializing all the Stores at 1675778599963Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778599963Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778599963Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778599963Cleaning up temporary data from old regions at 1675778599970 (+7 ms)Cleaning up detritus from prior splits at 1675778599970Region opened successfully at 1675778599974 (+4 ms) 2023-02-07 14:03:19,974 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:03:19,974 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:03:19,974 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:03:19,974 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:03:19,974 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:03:19,974 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:19,974 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778599974Disabling compacts and flushes for region at 1675778599974Disabling writes for close at 1675778599974Writing region close event to WAL at 1675778599974Closed at 1675778599974 2023-02-07 14:03:19,975 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:19,975 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 14:03:19,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 14:03:19,977 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 14:03:19,978 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 14:03:20,012 INFO [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(952): ClusterId : 285394b0-8aea-409f-89f8-62859ebd44cd 2023-02-07 14:03:20,012 INFO [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(952): ClusterId : 285394b0-8aea-409f-89f8-62859ebd44cd 2023-02-07 14:03:20,012 DEBUG [RS:1;jenkins-hbase4:42829] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:03:20,012 DEBUG [RS:0;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:03:20,015 DEBUG [RS:1;jenkins-hbase4:42829] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:03:20,015 DEBUG [RS:1;jenkins-hbase4:42829] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:03:20,015 DEBUG [RS:0;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:03:20,015 DEBUG [RS:0;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:03:20,017 DEBUG [RS:1;jenkins-hbase4:42829] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:03:20,017 DEBUG [RS:0;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:03:20,019 DEBUG [RS:1;jenkins-hbase4:42829] zookeeper.ReadOnlyZKClient(139): Connect 0x61ab880b to 127.0.0.1:50760 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:20,019 DEBUG [RS:0;jenkins-hbase4:40925] zookeeper.ReadOnlyZKClient(139): Connect 0x1060ea17 to 127.0.0.1:50760 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:20,026 DEBUG [RS:1;jenkins-hbase4:42829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f6c7a4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:20,026 DEBUG [RS:0;jenkins-hbase4:40925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ea7066b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:20,026 DEBUG [RS:1;jenkins-hbase4:42829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b53e37b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:20,026 DEBUG [RS:0;jenkins-hbase4:40925] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a988167, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:20,035 DEBUG [RS:0;jenkins-hbase4:40925] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40925 2023-02-07 14:03:20,035 DEBUG [RS:1;jenkins-hbase4:42829] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42829 2023-02-07 14:03:20,035 INFO [RS:0;jenkins-hbase4:40925] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:03:20,035 INFO [RS:1;jenkins-hbase4:42829] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:03:20,036 INFO [RS:1;jenkins-hbase4:42829] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:03:20,035 INFO [RS:0;jenkins-hbase4:40925] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:03:20,036 DEBUG [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:03:20,036 DEBUG [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:03:20,036 INFO [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,32847,1675778599716 with isa=jenkins-hbase4.apache.org/172.31.14.131:40925, startcode=1675778599766 2023-02-07 14:03:20,036 INFO [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,32847,1675778599716 with isa=jenkins-hbase4.apache.org/172.31.14.131:42829, startcode=1675778599792 2023-02-07 14:03:20,036 DEBUG [RS:0;jenkins-hbase4:40925] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:03:20,036 DEBUG [RS:1;jenkins-hbase4:42829] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:03:20,038 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38561, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:03:20,038 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47297, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:03:20,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32847] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:20,039 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:20,040 DEBUG [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c 2023-02-07 14:03:20,040 DEBUG [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45431 2023-02-07 14:03:20,040 DEBUG [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:03:20,040 DEBUG [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c 2023-02-07 14:03:20,040 DEBUG [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45431 2023-02-07 14:03:20,040 DEBUG [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:03:20,042 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:20,046 DEBUG [RS:0;jenkins-hbase4:40925] zookeeper.ZKUtil(162): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:20,046 WARN [RS:0;jenkins-hbase4:40925] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:20,046 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42829,1675778599792] 2023-02-07 14:03:20,046 INFO [RS:0;jenkins-hbase4:40925] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:20,046 DEBUG [RS:1;jenkins-hbase4:42829] zookeeper.ZKUtil(162): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:20,046 DEBUG [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/WALs/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:20,046 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40925,1675778599766] 2023-02-07 14:03:20,046 WARN [RS:1;jenkins-hbase4:42829] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:20,046 INFO [RS:1;jenkins-hbase4:42829] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:20,046 DEBUG [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/WALs/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:20,054 DEBUG [RS:0;jenkins-hbase4:40925] zookeeper.ZKUtil(162): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:20,054 DEBUG [RS:1;jenkins-hbase4:42829] zookeeper.ZKUtil(162): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:20,054 DEBUG [RS:0;jenkins-hbase4:40925] zookeeper.ZKUtil(162): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:20,054 DEBUG [RS:1;jenkins-hbase4:42829] zookeeper.ZKUtil(162): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:20,054 DEBUG [RS:1;jenkins-hbase4:42829] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:03:20,054 DEBUG [RS:0;jenkins-hbase4:40925] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:03:20,055 INFO [RS:1;jenkins-hbase4:42829] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:03:20,055 INFO [RS:0;jenkins-hbase4:40925] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:03:20,056 INFO [RS:1;jenkins-hbase4:42829] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:03:20,056 INFO [RS:1;jenkins-hbase4:42829] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:03:20,056 INFO [RS:1;jenkins-hbase4:42829] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,056 INFO [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:03:20,060 INFO [RS:1;jenkins-hbase4:42829] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,060 INFO [RS:0;jenkins-hbase4:40925] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:03:20,060 DEBUG [RS:1;jenkins-hbase4:42829] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,060 DEBUG [RS:1;jenkins-hbase4:42829] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,060 DEBUG [RS:1;jenkins-hbase4:42829] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,060 DEBUG [RS:1;jenkins-hbase4:42829] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,060 DEBUG [RS:1;jenkins-hbase4:42829] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,060 INFO [RS:0;jenkins-hbase4:40925] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:03:20,060 DEBUG [RS:1;jenkins-hbase4:42829] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:20,060 INFO [RS:0;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,060 DEBUG [RS:1;jenkins-hbase4:42829] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,060 DEBUG [RS:1;jenkins-hbase4:42829] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,060 DEBUG [RS:1;jenkins-hbase4:42829] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,060 DEBUG [RS:1;jenkins-hbase4:42829] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,061 INFO [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:03:20,064 INFO [RS:1;jenkins-hbase4:42829] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,064 INFO [RS:0;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,064 INFO [RS:1;jenkins-hbase4:42829] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,064 DEBUG [RS:0;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,064 INFO [RS:1;jenkins-hbase4:42829] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,064 DEBUG [RS:0;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,064 DEBUG [RS:0;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,064 DEBUG [RS:0;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,064 DEBUG [RS:0;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,064 DEBUG [RS:0;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:20,064 DEBUG [RS:0;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,064 DEBUG [RS:0;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,064 DEBUG [RS:0;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,064 DEBUG [RS:0;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:20,068 INFO [RS:0;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,069 INFO [RS:0;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,069 INFO [RS:0;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,085 INFO [RS:0;jenkins-hbase4:40925] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:03:20,085 INFO [RS:1;jenkins-hbase4:42829] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:03:20,085 INFO [RS:0;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40925,1675778599766-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,085 INFO [RS:1;jenkins-hbase4:42829] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42829,1675778599792-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,104 INFO [RS:1;jenkins-hbase4:42829] regionserver.Replication(203): jenkins-hbase4.apache.org,42829,1675778599792 started 2023-02-07 14:03:20,104 INFO [RS:0;jenkins-hbase4:40925] regionserver.Replication(203): jenkins-hbase4.apache.org,40925,1675778599766 started 2023-02-07 14:03:20,104 INFO [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42829,1675778599792, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42829, sessionid=0x1002f1814d70002 2023-02-07 14:03:20,104 INFO [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40925,1675778599766, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40925, sessionid=0x1002f1814d70001 2023-02-07 14:03:20,104 DEBUG [RS:1;jenkins-hbase4:42829] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:03:20,104 DEBUG [RS:1;jenkins-hbase4:42829] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:20,104 DEBUG [RS:0;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:03:20,105 DEBUG [RS:0;jenkins-hbase4:40925] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:20,105 DEBUG [RS:1;jenkins-hbase4:42829] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42829,1675778599792' 2023-02-07 14:03:20,105 DEBUG [RS:1;jenkins-hbase4:42829] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:20,105 DEBUG [RS:0;jenkins-hbase4:40925] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40925,1675778599766' 2023-02-07 14:03:20,105 DEBUG [RS:0;jenkins-hbase4:40925] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:20,105 DEBUG [RS:1;jenkins-hbase4:42829] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:20,105 DEBUG [RS:0;jenkins-hbase4:40925] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:20,105 DEBUG [RS:0;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:03:20,105 DEBUG [RS:0;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:03:20,105 DEBUG [RS:1;jenkins-hbase4:42829] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:03:20,106 DEBUG [RS:1;jenkins-hbase4:42829] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:03:20,106 DEBUG [RS:0;jenkins-hbase4:40925] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:20,106 DEBUG [RS:0;jenkins-hbase4:40925] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40925,1675778599766' 2023-02-07 14:03:20,106 DEBUG [RS:0;jenkins-hbase4:40925] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:20,106 DEBUG [RS:1;jenkins-hbase4:42829] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:20,106 DEBUG [RS:1;jenkins-hbase4:42829] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42829,1675778599792' 2023-02-07 14:03:20,106 DEBUG [RS:1;jenkins-hbase4:42829] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:20,106 DEBUG [RS:0;jenkins-hbase4:40925] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:20,106 DEBUG [RS:1;jenkins-hbase4:42829] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:20,106 DEBUG [RS:0;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:03:20,106 INFO [RS:0;jenkins-hbase4:40925] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:03:20,106 INFO [RS:0;jenkins-hbase4:40925] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:03:20,106 DEBUG [RS:1;jenkins-hbase4:42829] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:03:20,107 INFO [RS:1;jenkins-hbase4:42829] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:03:20,107 INFO [RS:1;jenkins-hbase4:42829] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:03:20,128 DEBUG [jenkins-hbase4:32847] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 14:03:20,128 DEBUG [jenkins-hbase4:32847] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:20,130 DEBUG [jenkins-hbase4:32847] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:20,130 DEBUG [jenkins-hbase4:32847] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:20,130 DEBUG [jenkins-hbase4:32847] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:20,130 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40925,1675778599766, state=OPENING 2023-02-07 14:03:20,131 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 14:03:20,132 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:20,133 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:03:20,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40925,1675778599766}] 2023-02-07 14:03:20,289 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:20,290 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 14:03:20,291 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37060, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 14:03:20,296 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 14:03:20,296 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:20,297 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40925%2C1675778599766.meta, suffix=.meta, logDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/WALs/jenkins-hbase4.apache.org,40925,1675778599766, archiveDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/oldWALs, maxLogs=32 2023-02-07 14:03:20,310 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46789,DS-d37c5e2b-15ee-4bdd-9973-2a68b09e73c2,DISK] 2023-02-07 14:03:20,310 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39647,DS-790aa020-35c7-4c93-af42-83a1b13e3f1b,DISK] 2023-02-07 14:03:20,312 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/WALs/jenkins-hbase4.apache.org,40925,1675778599766/jenkins-hbase4.apache.org%2C40925%2C1675778599766.meta.1675778600297.meta 2023-02-07 14:03:20,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46789,DS-d37c5e2b-15ee-4bdd-9973-2a68b09e73c2,DISK], DatanodeInfoWithStorage[127.0.0.1:39647,DS-790aa020-35c7-4c93-af42-83a1b13e3f1b,DISK]] 2023-02-07 14:03:20,312 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:20,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 14:03:20,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 14:03:20,313 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 14:03:20,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 14:03:20,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:20,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 14:03:20,313 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 14:03:20,314 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:03:20,315 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/info 2023-02-07 14:03:20,315 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/info 2023-02-07 14:03:20,315 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:03:20,316 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:20,316 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:03:20,317 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:20,317 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:20,317 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:03:20,317 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:20,317 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:03:20,318 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/table 2023-02-07 14:03:20,318 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/table 2023-02-07 14:03:20,318 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:03:20,319 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:20,319 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740 2023-02-07 14:03:20,320 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740 2023-02-07 14:03:20,322 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:03:20,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:03:20,323 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72674955, jitterRate=0.0829412192106247}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:03:20,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675778600313Writing region info on filesystem at 1675778600313Initializing all the Stores at 1675778600314 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778600314Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778600314Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778600314Cleaning up temporary data from old regions at 1675778600321 (+7 ms)Cleaning up detritus from prior splits at 1675778600321Running coprocessor post-open hooks at 1675778600323 (+2 ms)Region opened successfully at 1675778600323 2023-02-07 14:03:20,324 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675778600289 2023-02-07 14:03:20,327 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 14:03:20,328 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 14:03:20,328 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40925,1675778599766, state=OPEN 2023-02-07 14:03:20,330 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 14:03:20,330 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:03:20,331 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 14:03:20,331 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40925,1675778599766 in 197 msec 2023-02-07 14:03:20,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 14:03:20,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 356 msec 2023-02-07 14:03:20,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 397 msec 2023-02-07 14:03:20,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675778599813, completionTime=-1 2023-02-07 14:03:20,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 14:03:20,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 14:03:20,338 DEBUG [hconnection-0x19fe537-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:20,339 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37074, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:20,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 14:03:20,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675778660341 2023-02-07 14:03:20,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675778720341 2023-02-07 14:03:20,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-07 14:03:20,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32847,1675778599716-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32847,1675778599716-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32847,1675778599716-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:32847, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:20,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 14:03:20,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:20,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 14:03:20,351 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 14:03:20,351 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:03:20,352 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:03:20,353 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/hbase/namespace/92c2a9db2191e91acfb46b1a88e0ae3b 2023-02-07 14:03:20,353 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/hbase/namespace/92c2a9db2191e91acfb46b1a88e0ae3b empty. 2023-02-07 14:03:20,354 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/hbase/namespace/92c2a9db2191e91acfb46b1a88e0ae3b 2023-02-07 14:03:20,354 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 14:03:20,366 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:20,367 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 92c2a9db2191e91acfb46b1a88e0ae3b, NAME => 'hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp 2023-02-07 14:03:20,373 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:20,373 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 92c2a9db2191e91acfb46b1a88e0ae3b, disabling compactions & flushes 2023-02-07 14:03:20,373 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. 2023-02-07 14:03:20,373 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. 2023-02-07 14:03:20,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. after waiting 0 ms 2023-02-07 14:03:20,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. 2023-02-07 14:03:20,374 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. 2023-02-07 14:03:20,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 92c2a9db2191e91acfb46b1a88e0ae3b: Waiting for close lock at 1675778600373Disabling compacts and flushes for region at 1675778600373Disabling writes for close at 1675778600374 (+1 ms)Writing region close event to WAL at 1675778600374Closed at 1675778600374 2023-02-07 14:03:20,375 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:03:20,376 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778600376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778600376"}]},"ts":"1675778600376"} 2023-02-07 14:03:20,379 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 14:03:20,380 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:03:20,380 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778600380"}]},"ts":"1675778600380"} 2023-02-07 14:03:20,381 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 14:03:20,384 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:20,385 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:20,385 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:20,385 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:20,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=92c2a9db2191e91acfb46b1a88e0ae3b, ASSIGN}] 2023-02-07 14:03:20,387 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=92c2a9db2191e91acfb46b1a88e0ae3b, ASSIGN 2023-02-07 14:03:20,388 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=92c2a9db2191e91acfb46b1a88e0ae3b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42829,1675778599792; forceNewPlan=false, retain=false 2023-02-07 14:03:20,538 INFO [jenkins-hbase4:32847] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 14:03:20,538 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=92c2a9db2191e91acfb46b1a88e0ae3b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:20,538 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778600538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778600538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778600538"}]},"ts":"1675778600538"} 2023-02-07 14:03:20,540 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 92c2a9db2191e91acfb46b1a88e0ae3b, server=jenkins-hbase4.apache.org,42829,1675778599792}] 2023-02-07 14:03:20,692 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:20,692 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 14:03:20,694 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58104, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 14:03:20,697 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. 2023-02-07 14:03:20,698 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42829%2C1675778599792, suffix=, logDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/WALs/jenkins-hbase4.apache.org,42829,1675778599792, archiveDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/oldWALs, maxLogs=32 2023-02-07 14:03:20,711 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46789,DS-d37c5e2b-15ee-4bdd-9973-2a68b09e73c2,DISK] 2023-02-07 14:03:20,711 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39647,DS-790aa020-35c7-4c93-af42-83a1b13e3f1b,DISK] 2023-02-07 14:03:20,713 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/WALs/jenkins-hbase4.apache.org,42829,1675778599792/jenkins-hbase4.apache.org%2C42829%2C1675778599792.1675778600698 2023-02-07 14:03:20,716 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46789,DS-d37c5e2b-15ee-4bdd-9973-2a68b09e73c2,DISK], DatanodeInfoWithStorage[127.0.0.1:39647,DS-790aa020-35c7-4c93-af42-83a1b13e3f1b,DISK]] 2023-02-07 14:03:20,716 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 92c2a9db2191e91acfb46b1a88e0ae3b, NAME => 'hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:20,716 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 92c2a9db2191e91acfb46b1a88e0ae3b 2023-02-07 14:03:20,716 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:20,716 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 92c2a9db2191e91acfb46b1a88e0ae3b 2023-02-07 14:03:20,716 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 92c2a9db2191e91acfb46b1a88e0ae3b 2023-02-07 14:03:20,718 INFO [StoreOpener-92c2a9db2191e91acfb46b1a88e0ae3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 92c2a9db2191e91acfb46b1a88e0ae3b 2023-02-07 14:03:20,719 DEBUG [StoreOpener-92c2a9db2191e91acfb46b1a88e0ae3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/namespace/92c2a9db2191e91acfb46b1a88e0ae3b/info 2023-02-07 14:03:20,719 DEBUG [StoreOpener-92c2a9db2191e91acfb46b1a88e0ae3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/namespace/92c2a9db2191e91acfb46b1a88e0ae3b/info 2023-02-07 14:03:20,719 INFO [StoreOpener-92c2a9db2191e91acfb46b1a88e0ae3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92c2a9db2191e91acfb46b1a88e0ae3b columnFamilyName info 2023-02-07 14:03:20,719 INFO [StoreOpener-92c2a9db2191e91acfb46b1a88e0ae3b-1] regionserver.HStore(310): Store=92c2a9db2191e91acfb46b1a88e0ae3b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:20,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/namespace/92c2a9db2191e91acfb46b1a88e0ae3b 2023-02-07 14:03:20,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/namespace/92c2a9db2191e91acfb46b1a88e0ae3b 2023-02-07 14:03:20,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 92c2a9db2191e91acfb46b1a88e0ae3b 2023-02-07 14:03:20,724 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/namespace/92c2a9db2191e91acfb46b1a88e0ae3b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:20,724 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 92c2a9db2191e91acfb46b1a88e0ae3b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61611220, jitterRate=-0.0819212794303894}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:03:20,724 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 92c2a9db2191e91acfb46b1a88e0ae3b: Running coprocessor pre-open hook at 1675778600716Writing region info on filesystem at 1675778600716Initializing all the Stores at 1675778600717 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778600717Cleaning up temporary data from old regions at 1675778600721 (+4 ms)Cleaning up detritus from prior splits at 1675778600721Running coprocessor post-open hooks at 1675778600724 (+3 ms)Region opened successfully at 1675778600724 2023-02-07 14:03:20,725 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b., pid=6, masterSystemTime=1675778600692 2023-02-07 14:03:20,728 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. 2023-02-07 14:03:20,728 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. 2023-02-07 14:03:20,728 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=92c2a9db2191e91acfb46b1a88e0ae3b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:20,729 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778600728"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778600728"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778600728"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778600728"}]},"ts":"1675778600728"} 2023-02-07 14:03:20,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 14:03:20,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 92c2a9db2191e91acfb46b1a88e0ae3b, server=jenkins-hbase4.apache.org,42829,1675778599792 in 190 msec 2023-02-07 14:03:20,732 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 14:03:20,732 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=92c2a9db2191e91acfb46b1a88e0ae3b, ASSIGN in 346 msec 2023-02-07 14:03:20,733 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:03:20,733 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778600733"}]},"ts":"1675778600733"} 2023-02-07 14:03:20,734 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 14:03:20,736 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:03:20,737 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 387 msec 2023-02-07 14:03:20,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 14:03:20,752 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:20,752 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:20,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:20,755 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58118, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:20,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 14:03:20,766 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:20,772 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 15 msec 2023-02-07 14:03:20,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 14:03:20,785 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:20,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-07 14:03:20,794 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 14:03:20,796 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 14:03:20,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.976sec 2023-02-07 14:03:20,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 14:03:20,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 14:03:20,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 14:03:20,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32847,1675778599716-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 14:03:20,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32847,1675778599716-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 14:03:20,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 14:03:20,812 DEBUG [Listener at localhost/43889] zookeeper.ReadOnlyZKClient(139): Connect 0x74195f87 to 127.0.0.1:50760 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:20,820 DEBUG [Listener at localhost/43889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a9814b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:20,822 DEBUG [hconnection-0x1d13d8ea-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:20,824 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37086, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:20,825 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,32847,1675778599716 2023-02-07 14:03:20,825 DEBUG [Listener at localhost/43889] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 14:03:20,825 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:20,825 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:20,827 DEBUG [Listener at localhost/43889] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 14:03:20,828 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59698, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 14:03:20,829 INFO [Listener at localhost/43889] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-07 14:03:20,829 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-07 14:03:20,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 14:03:20,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:59698 deadline: 1675778660829, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-07 14:03:20,830 INFO [Listener at localhost/43889] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-07 14:03:20,830 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:20,830 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:20,832 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:20,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 14:03:20,834 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:03:20,834 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-07 14:03:20,835 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:20,835 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:20,835 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:03:20,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:20,836 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:20,837 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb empty. 2023-02-07 14:03:20,837 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:20,837 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-07 14:03:20,845 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:20,846 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 68a5bd1a89b1b13f758955648e4bc5fb, NAME => 'testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp 2023-02-07 14:03:20,853 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:20,853 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 68a5bd1a89b1b13f758955648e4bc5fb, disabling compactions & flushes 2023-02-07 14:03:20,853 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:20,853 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:20,853 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. after waiting 0 ms 2023-02-07 14:03:20,853 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:20,853 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:20,853 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 68a5bd1a89b1b13f758955648e4bc5fb: Waiting for close lock at 1675778600853Disabling compacts and flushes for region at 1675778600853Disabling writes for close at 1675778600853Writing region close event to WAL at 1675778600853Closed at 1675778600853 2023-02-07 14:03:20,855 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:03:20,856 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675778600856"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778600856"}]},"ts":"1675778600856"} 2023-02-07 14:03:20,857 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 14:03:20,858 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:03:20,858 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778600858"}]},"ts":"1675778600858"} 2023-02-07 14:03:20,859 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-07 14:03:20,862 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:20,863 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:20,863 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:20,863 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:20,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=68a5bd1a89b1b13f758955648e4bc5fb, ASSIGN}] 2023-02-07 14:03:20,865 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=68a5bd1a89b1b13f758955648e4bc5fb, ASSIGN 2023-02-07 14:03:20,866 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=68a5bd1a89b1b13f758955648e4bc5fb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40925,1675778599766; forceNewPlan=false, retain=false 2023-02-07 14:03:20,936 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:20,936 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:20,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:21,016 INFO [jenkins-hbase4:32847] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 14:03:21,016 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=68a5bd1a89b1b13f758955648e4bc5fb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,017 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675778601016"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778601016"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778601016"}]},"ts":"1675778601016"} 2023-02-07 14:03:21,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 68a5bd1a89b1b13f758955648e4bc5fb, server=jenkins-hbase4.apache.org,40925,1675778599766}] 2023-02-07 14:03:21,108 INFO [RS:0;jenkins-hbase4:40925] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40925%2C1675778599766, suffix=, logDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/WALs/jenkins-hbase4.apache.org,40925,1675778599766, archiveDir=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/oldWALs, maxLogs=32 2023-02-07 14:03:21,120 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39647,DS-790aa020-35c7-4c93-af42-83a1b13e3f1b,DISK] 2023-02-07 14:03:21,120 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46789,DS-d37c5e2b-15ee-4bdd-9973-2a68b09e73c2,DISK] 2023-02-07 14:03:21,122 INFO [RS:0;jenkins-hbase4:40925] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/WALs/jenkins-hbase4.apache.org,40925,1675778599766/jenkins-hbase4.apache.org%2C40925%2C1675778599766.1675778601108 2023-02-07 14:03:21,122 DEBUG [RS:0;jenkins-hbase4:40925] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39647,DS-790aa020-35c7-4c93-af42-83a1b13e3f1b,DISK], DatanodeInfoWithStorage[127.0.0.1:46789,DS-d37c5e2b-15ee-4bdd-9973-2a68b09e73c2,DISK]] 2023-02-07 14:03:21,137 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:21,137 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:21,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:21,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:21,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 68a5bd1a89b1b13f758955648e4bc5fb, NAME => 'testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:21,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:21,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:21,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:21,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:21,173 INFO [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:21,175 DEBUG [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1 2023-02-07 14:03:21,175 DEBUG [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1 2023-02-07 14:03:21,175 INFO [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68a5bd1a89b1b13f758955648e4bc5fb columnFamilyName f1 2023-02-07 14:03:21,175 INFO [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] regionserver.HStore(310): Store=68a5bd1a89b1b13f758955648e4bc5fb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:21,175 INFO [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:21,176 DEBUG [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2 2023-02-07 14:03:21,176 DEBUG [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2 2023-02-07 14:03:21,177 INFO [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68a5bd1a89b1b13f758955648e4bc5fb columnFamilyName f2 2023-02-07 14:03:21,177 INFO [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] regionserver.HStore(310): Store=68a5bd1a89b1b13f758955648e4bc5fb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:21,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:21,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:21,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:21,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:21,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:21,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 68a5bd1a89b1b13f758955648e4bc5fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73436938, jitterRate=0.09429565072059631}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:21,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 68a5bd1a89b1b13f758955648e4bc5fb: Running coprocessor pre-open hook at 1675778601173Writing region info on filesystem at 1675778601173Initializing all the Stores at 1675778601173Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778601173Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778601173Cleaning up temporary data from old regions at 1675778601178 (+5 ms)Cleaning up detritus from prior splits at 1675778601178Running coprocessor post-open hooks at 1675778601182 (+4 ms)Region opened successfully at 1675778601182 2023-02-07 14:03:21,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb., pid=12, masterSystemTime=1675778601170 2023-02-07 14:03:21,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:21,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:21,184 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=68a5bd1a89b1b13f758955648e4bc5fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,184 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675778601184"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778601184"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778601184"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778601184"}]},"ts":"1675778601184"} 2023-02-07 14:03:21,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-07 14:03:21,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 68a5bd1a89b1b13f758955648e4bc5fb, server=jenkins-hbase4.apache.org,40925,1675778599766 in 167 msec 2023-02-07 14:03:21,188 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-07 14:03:21,188 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=68a5bd1a89b1b13f758955648e4bc5fb, ASSIGN in 322 msec 2023-02-07 14:03:21,188 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:03:21,188 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778601188"}]},"ts":"1675778601188"} 2023-02-07 14:03:21,189 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-07 14:03:21,191 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:03:21,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 359 msec 2023-02-07 14:03:21,439 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:21,439 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:21,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:21,440 INFO [Listener at localhost/43889] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-07 14:03:21,440 DEBUG [Listener at localhost/43889] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-07 14:03:21,441 INFO [Listener at localhost/43889] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:03:21,442 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-07 14:03:21,443 INFO [Listener at localhost/43889] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:03:21,443 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-07 14:03:21,443 INFO [Listener at localhost/43889] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 14:03:21,472 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:21,553 INFO [Listener at localhost/43889] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 14:03:21,553 INFO [Listener at localhost/43889] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 14:03:21,554 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:21,554 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:21,555 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-07 14:03:21,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675778601555 (current time:1675778601555). 2023-02-07 14:03:21,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 14:03:21,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] zookeeper.ReadOnlyZKClient(139): Connect 0x017d7755 to 127.0.0.1:50760 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:21,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59994c4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:21,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:21,560 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37102, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:21,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x017d7755 to 127.0.0.1:50760 2023-02-07 14:03:21,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:21,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 14:03:21,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-07 14:03:21,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-07 14:03:21,565 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-07 14:03:21,566 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1675779201566 2023-02-07 14:03:21,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-07 14:03:21,566 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,567 DEBUG [Listener at localhost/43889] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 14:03:21,567 DEBUG [Listener at localhost/43889] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 14:03:21,568 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-07 14:03:21,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-07 14:03:21,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-07 14:03:21,570 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-07 14:03:21,570 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1675779201570 2023-02-07 14:03:21,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,577 INFO [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-07 14:03:21,577 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:21,578 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-07 14:03:21,578 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-07 14:03:21,578 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,578 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,579 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:21,579 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:21,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:21,579 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:21,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:21,580 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,580 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-07 14:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-07 14:03:21,581 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-07 14:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,581 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-07 14:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,581 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-07 14:03:21,581 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:21,581 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-07 14:03:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 14:03:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 14:03:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-07 14:03:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-07 14:03:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40925,1675778599766' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-07 14:03:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42829,1675778599792' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-07 14:03:21,584 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,584 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:21,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:21,585 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,585 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,585 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:21,585 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,585 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:21,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:21,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40925,1675778599766' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-07 14:03:21,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48910f0f[Count = 0] remaining members to acquire global barrier 2023-02-07 14:03:21,586 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-07 14:03:21,587 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,588 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,588 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 14:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 14:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-07 14:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,42829,1675778599792' in zk 2023-02-07 14:03:21,589 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-07 14:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 14:03:21,589 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:21,589 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:03:21,589 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. started... 2023-02-07 14:03:21,589 INFO [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 68a5bd1a89b1b13f758955648e4bc5fb 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-07 14:03:21,590 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-07 14:03:21,590 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:21,590 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-07 14:03:21,603 INFO [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/.tmp/f1/ef102edfcf2a45f4a86bbe589ba0964a 2023-02-07 14:03:21,620 INFO [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/.tmp/f2/ea6aa98169bf40bd93394d8544cee4eb 2023-02-07 14:03:21,623 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/.tmp/f1/ef102edfcf2a45f4a86bbe589ba0964a as hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1/ef102edfcf2a45f4a86bbe589ba0964a 2023-02-07 14:03:21,627 INFO [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1/ef102edfcf2a45f4a86bbe589ba0964a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 14:03:21,627 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/.tmp/f2/ea6aa98169bf40bd93394d8544cee4eb as hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2/ea6aa98169bf40bd93394d8544cee4eb 2023-02-07 14:03:21,631 INFO [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2/ea6aa98169bf40bd93394d8544cee4eb, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 14:03:21,632 INFO [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 68a5bd1a89b1b13f758955648e4bc5fb in 43ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:21,632 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-07 14:03:21,632 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 68a5bd1a89b1b13f758955648e4bc5fb: 2023-02-07 14:03:21,632 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,632 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:21,632 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1/ef102edfcf2a45f4a86bbe589ba0964a] hfiles 2023-02-07 14:03:21,632 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1/ef102edfcf2a45f4a86bbe589ba0964a for snapshot=testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,632 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2/ea6aa98169bf40bd93394d8544cee4eb] hfiles 2023-02-07 14:03:21,632 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2/ea6aa98169bf40bd93394d8544cee4eb for snapshot=testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,641 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. completed. 2023-02-07 14:03:21,641 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:21,641 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-07 14:03:21,641 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-07 14:03:21,641 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,641 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-07 14:03:21,641 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40925,1675778599766' in zk 2023-02-07 14:03:21,643 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-07 14:03:21,643 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:21,643 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-07 14:03:21,643 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:21,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:21,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:21,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:21,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:21,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:21,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:21,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,40925,1675778599766': 2023-02-07 14:03:21,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40925,1675778599766' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-07 14:03:21,646 INFO [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-07 14:03:21,646 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:03:21,646 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:03:21,646 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,646 INFO [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 14:03:21,648 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,648 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,648 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:21,648 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,648 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:21,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:21,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:21,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:21,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:21,649 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:21,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:21,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:21,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:21,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,649 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:21,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:21,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,651 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:21,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:21,651 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:21,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,661 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,661 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:21,661 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,661 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:21,661 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,661 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:21,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:21,661 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:21,661 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:21,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:21,661 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:21,661 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,661 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:21,661 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,661 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:21,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:21,661 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:21,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:21,661 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,668 DEBUG [Listener at localhost/43889] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:21,668 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:21,668 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:21,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-07 14:03:21,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:03:21,670 DEBUG [Listener at localhost/43889] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 14:03:21,676 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,692 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-07 14:03:21,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,692 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:21,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1675778601566Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1675778601661 (+95 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1675778601661Writing data manifest for testWithMockedMapReduceSingleRegion at 1675778601663 (+2 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1675778601671 (+8 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1675778601692 (+21 ms) 2023-02-07 14:03:21,694 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-07 14:03:21,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 127 msec 2023-02-07 14:03:21,870 DEBUG [Listener at localhost/43889] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:21,870 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:21,870 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:21,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-07 14:03:21,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 14:03:21,872 INFO [Listener at localhost/43889] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 14:03:21,872 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:21,872 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:21,876 INFO [Listener at localhost/43889] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 14:03:21,880 INFO [Listener at localhost/43889] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 14:03:21,903 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 14:03:21,903 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-07 14:03:21,911 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,075 INFO [Listener at localhost/43889] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 14:03:22,078 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:22,078 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:22,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 14:03:22,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,081 INFO [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-07 14:03:22,081 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:22,082 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-07 14:03:22,082 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-07 14:03:22,082 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,083 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,084 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:22,084 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:22,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:22,084 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:22,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:22,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:22,084 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,084 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:03:22,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,085 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,085 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:03:22,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,085 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:03:22,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,085 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,086 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-07 14:03:22,086 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:22,088 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 14:03:22,088 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-07 14:03:22,088 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-07 14:03:22,088 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42829,1675778599792' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-07 14:03:22,089 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:22,089 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 14:03:22,090 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,091 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,091 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:22,092 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 14:03:22,092 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 14:03:22,092 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,092 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. started... 2023-02-07 14:03:22,092 INFO [rs(jenkins-hbase4.apache.org,40925,1675778599766)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 68a5bd1a89b1b13f758955648e4bc5fb 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-07 14:03:22,108 INFO [rs(jenkins-hbase4.apache.org,40925,1675778599766)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/.tmp/f1/901a9a1ef64d4fc8b144726d62d52108 2023-02-07 14:03:22,132 INFO [rs(jenkins-hbase4.apache.org,40925,1675778599766)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/.tmp/f2/26ce54b835054229858cbf4b62c5cbc5 2023-02-07 14:03:22,136 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/.tmp/f1/901a9a1ef64d4fc8b144726d62d52108 as hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1/901a9a1ef64d4fc8b144726d62d52108 2023-02-07 14:03:22,141 INFO [rs(jenkins-hbase4.apache.org,40925,1675778599766)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1/901a9a1ef64d4fc8b144726d62d52108, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 14:03:22,141 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/.tmp/f2/26ce54b835054229858cbf4b62c5cbc5 as hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2/26ce54b835054229858cbf4b62c5cbc5 2023-02-07 14:03:22,146 INFO [rs(jenkins-hbase4.apache.org,40925,1675778599766)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2/26ce54b835054229858cbf4b62c5cbc5, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 14:03:22,147 INFO [rs(jenkins-hbase4.apache.org,40925,1675778599766)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 68a5bd1a89b1b13f758955648e4bc5fb in 55ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:22,148 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 68a5bd1a89b1b13f758955648e4bc5fb: 2023-02-07 14:03:22,148 DEBUG [rs(jenkins-hbase4.apache.org,40925,1675778599766)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,148 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 14:03:22,148 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 14:03:22,148 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,148 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-07 14:03:22,148 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40925,1675778599766' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-07 14:03:22,149 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,149 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:22,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:22,150 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,150 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:22,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:22,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40925,1675778599766' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-07 14:03:22,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cae92c5[Count = 0] remaining members to acquire global barrier 2023-02-07 14:03:22,151 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-07 14:03:22,151 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,155 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,155 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,155 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 14:03:22,155 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 14:03:22,155 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-07 14:03:22,155 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,155 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:03:22,155 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40925,1675778599766' in zk 2023-02-07 14:03:22,155 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-07 14:03:22,156 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,42829,1675778599792' in zk 2023-02-07 14:03:22,157 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-07 14:03:22,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:22,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:22,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,40925,1675778599766' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-07 14:03:22,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-07 14:03:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,42829,1675778599792' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-07 14:03:22,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:22,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:22,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:22,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:22,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,40925,1675778599766': 2023-02-07 14:03:22,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40925,1675778599766' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-07 14:03:22,160 INFO [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-07 14:03:22,160 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:03:22,160 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:03:22,160 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,160 INFO [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 14:03:22,161 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,161 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,161 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:22,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:22,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,161 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:22,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,161 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:22,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:22,162 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:22,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:22,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:22,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:22,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:22,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,162 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:22,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:22,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,164 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:22,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:22,164 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:22,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,168 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,168 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,168 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:22,168 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:22,168 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:22,168 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:22,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:22,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:22,168 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:22,168 DEBUG [(jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:22,168 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:22,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:22,169 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,168 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-07 14:03:22,169 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 14:03:22,169 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:22,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:22,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:22,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:22,169 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:22,169 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,169 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,169 DEBUG [Listener at localhost/43889] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-07 14:03:22,169 DEBUG [Listener at localhost/43889] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 14:03:22,269 DEBUG [Listener at localhost/43889] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 14:03:22,270 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:22,270 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:22,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 14:03:22,275 INFO [Listener at localhost/43889] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675778601555 type: FLUSH version: 2 ttl: 0 2023-02-07 14:03:22,275 DEBUG [Listener at localhost/43889] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45431/user/jenkins/test-data/d706f73a-724b-e0fd-b819-71e9933e9c6c/testWithMockedMapReduceSingleRegion/20b18584-ee5f-41fa-bbdf-8aa2aaf50c59/data/default/testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,276 INFO [Listener at localhost/43889] snapshot.RestoreSnapshotHelper(239): region to add: 68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:22,276 INFO [Listener at localhost/43889] snapshot.RestoreSnapshotHelper(585): clone region=68a5bd1a89b1b13f758955648e4bc5fb as 68a5bd1a89b1b13f758955648e4bc5fb in snapshot testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,277 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 68a5bd1a89b1b13f758955648e4bc5fb, NAME => 'testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45431/user/jenkins/test-data/d706f73a-724b-e0fd-b819-71e9933e9c6c/testWithMockedMapReduceSingleRegion/20b18584-ee5f-41fa-bbdf-8aa2aaf50c59 2023-02-07 14:03:22,282 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:22,282 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ef102edfcf2a45f4a86bbe589ba0964a from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,284 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ea6aa98169bf40bd93394d8544cee4eb from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,286 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 68a5bd1a89b1b13f758955648e4bc5fb, disabling compactions & flushes 2023-02-07 14:03:22,286 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,286 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,286 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. after waiting 0 ms 2023-02-07 14:03:22,286 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,286 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,286 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 68a5bd1a89b1b13f758955648e4bc5fb: Waiting for close lock at 1675778602286Disabling compacts and flushes for region at 1675778602286Disabling writes for close at 1675778602286Writing region close event to WAL at 1675778602286Closed at 1675778602286 2023-02-07 14:03:22,286 INFO [Listener at localhost/43889] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1675778601555 type: FLUSH version: 2 ttl: 0 2023-02-07 14:03:22,286 DEBUG [Listener at localhost/43889] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45431/user/jenkins/test-data/d706f73a-724b-e0fd-b819-71e9933e9c6c/testWithMockedMapReduceSingleRegion/20b18584-ee5f-41fa-bbdf-8aa2aaf50c59 2023-02-07 14:03:22,286 DEBUG [Listener at localhost/43889] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45431/user/jenkins/test-data/d706f73a-724b-e0fd-b819-71e9933e9c6c/testWithMockedMapReduceSingleRegion/20b18584-ee5f-41fa-bbdf-8aa2aaf50c59 2023-02-07 14:03:22,287 DEBUG [Listener at localhost/43889] util.CommonFSUtils(699): |-data/ 2023-02-07 14:03:22,287 DEBUG [Listener at localhost/43889] util.CommonFSUtils(699): |----default/ 2023-02-07 14:03:22,287 DEBUG [Listener at localhost/43889] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-07 14:03:22,288 DEBUG [Listener at localhost/43889] util.CommonFSUtils(699): |----------68a5bd1a89b1b13f758955648e4bc5fb/ 2023-02-07 14:03:22,288 DEBUG [Listener at localhost/43889] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:22,288 DEBUG [Listener at localhost/43889] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:22,289 DEBUG [Listener at localhost/43889] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=68a5bd1a89b1b13f758955648e4bc5fb-ef102edfcf2a45f4a86bbe589ba0964a 2023-02-07 14:03:22,289 DEBUG [Listener at localhost/43889] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:22,289 DEBUG [Listener at localhost/43889] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=68a5bd1a89b1b13f758955648e4bc5fb-ea6aa98169bf40bd93394d8544cee4eb 2023-02-07 14:03:22,292 INFO [Listener at localhost/43889] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 14:03:22,296 DEBUG [Listener at localhost/43889] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:22,296 INFO [Listener at localhost/43889] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:22,296 DEBUG [Listener at localhost/43889] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:22,300 INFO [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:22,301 DEBUG [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/d706f73a-724b-e0fd-b819-71e9933e9c6c/testWithMockedMapReduceSingleRegion/20b18584-ee5f-41fa-bbdf-8aa2aaf50c59/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1 2023-02-07 14:03:22,301 INFO [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68a5bd1a89b1b13f758955648e4bc5fb columnFamilyName f1 2023-02-07 14:03:22,304 DEBUG [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] regionserver.HStore(539): loaded hdfs://localhost:45431/user/jenkins/test-data/d706f73a-724b-e0fd-b819-71e9933e9c6c/testWithMockedMapReduceSingleRegion/20b18584-ee5f-41fa-bbdf-8aa2aaf50c59/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1/testWithMockedMapReduceSingleRegion=68a5bd1a89b1b13f758955648e4bc5fb-ef102edfcf2a45f4a86bbe589ba0964a 2023-02-07 14:03:22,304 INFO [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] regionserver.HStore(310): Store=68a5bd1a89b1b13f758955648e4bc5fb/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:22,305 INFO [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:22,305 DEBUG [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45431/user/jenkins/test-data/d706f73a-724b-e0fd-b819-71e9933e9c6c/testWithMockedMapReduceSingleRegion/20b18584-ee5f-41fa-bbdf-8aa2aaf50c59/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2 2023-02-07 14:03:22,306 INFO [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68a5bd1a89b1b13f758955648e4bc5fb columnFamilyName f2 2023-02-07 14:03:22,309 DEBUG [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] regionserver.HStore(539): loaded hdfs://localhost:45431/user/jenkins/test-data/d706f73a-724b-e0fd-b819-71e9933e9c6c/testWithMockedMapReduceSingleRegion/20b18584-ee5f-41fa-bbdf-8aa2aaf50c59/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2/testWithMockedMapReduceSingleRegion=68a5bd1a89b1b13f758955648e4bc5fb-ea6aa98169bf40bd93394d8544cee4eb 2023-02-07 14:03:22,309 INFO [StoreOpener-68a5bd1a89b1b13f758955648e4bc5fb-1] regionserver.HStore(310): Store=68a5bd1a89b1b13f758955648e4bc5fb/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:22,309 DEBUG [Listener at localhost/43889] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:22,309 INFO [Listener at localhost/43889] regionserver.HRegion(1071): Opened 68a5bd1a89b1b13f758955648e4bc5fb; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70010329, jitterRate=0.04323519766330719}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:22,309 DEBUG [Listener at localhost/43889] regionserver.HRegion(964): Region open journal for 68a5bd1a89b1b13f758955648e4bc5fb: Writing region info on filesystem at 1675778602297Initializing all the Stores at 1675778602297Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778602297Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778602299 (+2 ms)Region opened successfully at 1675778602309 (+10 ms) 2023-02-07 14:03:22,353 DEBUG [Listener at localhost/43889] regionserver.HRegion(1603): Closing 68a5bd1a89b1b13f758955648e4bc5fb, disabling compactions & flushes 2023-02-07 14:03:22,354 INFO [Listener at localhost/43889] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,354 DEBUG [Listener at localhost/43889] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,354 DEBUG [Listener at localhost/43889] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. after waiting 0 ms 2023-02-07 14:03:22,354 DEBUG [Listener at localhost/43889] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,354 INFO [Listener at localhost/43889] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,355 DEBUG [Listener at localhost/43889] regionserver.HRegion(1557): Region close journal for 68a5bd1a89b1b13f758955648e4bc5fb: Waiting for close lock at 1675778602353Disabling compacts and flushes for region at 1675778602353Disabling writes for close at 1675778602354 (+1 ms)Writing region close event to WAL at 1675778602354Closed at 1675778602354 2023-02-07 14:03:22,357 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:22,357 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:22,359 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-07 14:03:22,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,361 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:22,361 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:22,362 INFO [Listener at localhost/43889] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,362 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,365 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:22,365 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:22,365 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778602365"}]},"ts":"1675778602365"} 2023-02-07 14:03:22,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 14:03:22,367 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-07 14:03:22,368 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-07 14:03:22,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=68a5bd1a89b1b13f758955648e4bc5fb, UNASSIGN}] 2023-02-07 14:03:22,370 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=68a5bd1a89b1b13f758955648e4bc5fb, UNASSIGN 2023-02-07 14:03:22,371 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=68a5bd1a89b1b13f758955648e4bc5fb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,371 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675778602371"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778602371"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778602371"}]},"ts":"1675778602371"} 2023-02-07 14:03:22,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 68a5bd1a89b1b13f758955648e4bc5fb, server=jenkins-hbase4.apache.org,40925,1675778599766}] 2023-02-07 14:03:22,466 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:22,466 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:22,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 14:03:22,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:22,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 68a5bd1a89b1b13f758955648e4bc5fb, disabling compactions & flushes 2023-02-07 14:03:22,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. after waiting 0 ms 2023-02-07 14:03:22,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:22,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb. 2023-02-07 14:03:22,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 68a5bd1a89b1b13f758955648e4bc5fb: Waiting for close lock at 1675778602524Running coprocessor pre-close hooks at 1675778602524Disabling compacts and flushes for region at 1675778602524Disabling writes for close at 1675778602524Writing region close event to WAL at 1675778602525 (+1 ms)Running coprocessor post-close hooks at 1675778602528 (+3 ms)Closed at 1675778602528 2023-02-07 14:03:22,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:22,530 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=68a5bd1a89b1b13f758955648e4bc5fb, regionState=CLOSED 2023-02-07 14:03:22,531 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675778602530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778602530"}]},"ts":"1675778602530"} 2023-02-07 14:03:22,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-07 14:03:22,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 68a5bd1a89b1b13f758955648e4bc5fb, server=jenkins-hbase4.apache.org,40925,1675778599766 in 160 msec 2023-02-07 14:03:22,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-07 14:03:22,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=68a5bd1a89b1b13f758955648e4bc5fb, UNASSIGN in 164 msec 2023-02-07 14:03:22,535 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778602534"}]},"ts":"1675778602534"} 2023-02-07 14:03:22,536 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-07 14:03:22,537 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-07 14:03:22,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 176 msec 2023-02-07 14:03:22,668 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:22,668 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:22,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 14:03:22,669 INFO [Listener at localhost/43889] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-07 14:03:22,669 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:22,669 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:22,670 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,673 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,673 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:22,673 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:22,673 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 14:03:22,676 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:22,678 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1, FileablePath, hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2, FileablePath, hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/recovered.edits] 2023-02-07 14:03:22,681 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1/901a9a1ef64d4fc8b144726d62d52108 to hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/archive/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1/901a9a1ef64d4fc8b144726d62d52108 2023-02-07 14:03:22,682 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1/ef102edfcf2a45f4a86bbe589ba0964a to hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/archive/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f1/ef102edfcf2a45f4a86bbe589ba0964a 2023-02-07 14:03:22,687 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2/26ce54b835054229858cbf4b62c5cbc5 to hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/archive/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2/26ce54b835054229858cbf4b62c5cbc5 2023-02-07 14:03:22,688 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2/ea6aa98169bf40bd93394d8544cee4eb to hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/archive/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/f2/ea6aa98169bf40bd93394d8544cee4eb 2023-02-07 14:03:22,690 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/recovered.edits/12.seqid to hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/archive/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb/recovered.edits/12.seqid 2023-02-07 14:03:22,690 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/.tmp/data/default/testWithMockedMapReduceSingleRegion/68a5bd1a89b1b13f758955648e4bc5fb 2023-02-07 14:03:22,690 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-07 14:03:22,692 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,694 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-07 14:03:22,695 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-07 14:03:22,696 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,696 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-07 14:03:22,696 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778602696"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:22,697 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-07 14:03:22,697 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 68a5bd1a89b1b13f758955648e4bc5fb, NAME => 'testWithMockedMapReduceSingleRegion,,1675778600832.68a5bd1a89b1b13f758955648e4bc5fb.', STARTKEY => '', ENDKEY => ''}] 2023-02-07 14:03:22,697 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-07 14:03:22,697 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675778602697"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:22,698 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-07 14:03:22,700 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-07 14:03:22,700 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 30 msec 2023-02-07 14:03:22,774 INFO [Listener at localhost/43889] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:22,774 INFO [Listener at localhost/43889] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:22,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32847] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 14:03:22,775 INFO [Listener at localhost/43889] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-07 14:03:22,776 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 14:03:22,776 INFO [Listener at localhost/43889] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 14:03:22,776 DEBUG [Listener at localhost/43889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74195f87 to 127.0.0.1:50760 2023-02-07 14:03:22,776 DEBUG [Listener at localhost/43889] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:22,776 DEBUG [Listener at localhost/43889] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 14:03:22,776 DEBUG [Listener at localhost/43889] util.JVMClusterUtil(257): Found active master hash=696936561, stopped=false 2023-02-07 14:03:22,776 INFO [Listener at localhost/43889] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,32847,1675778599716 2023-02-07 14:03:22,779 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:22,779 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:22,779 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:22,779 INFO [Listener at localhost/43889] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 14:03:22,779 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:22,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:22,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:22,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:22,781 DEBUG [Listener at localhost/43889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d2fdca9 to 127.0.0.1:50760 2023-02-07 14:03:22,781 DEBUG [Listener at localhost/43889] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:22,781 INFO [Listener at localhost/43889] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40925,1675778599766' ***** 2023-02-07 14:03:22,781 INFO [Listener at localhost/43889] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:03:22,781 INFO [Listener at localhost/43889] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42829,1675778599792' ***** 2023-02-07 14:03:22,781 INFO [Listener at localhost/43889] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:03:22,781 INFO [RS:0;jenkins-hbase4:40925] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:03:22,781 INFO [RS:1;jenkins-hbase4:42829] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:03:22,781 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:03:22,781 INFO [RS:1;jenkins-hbase4:42829] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:03:22,781 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:03:22,782 INFO [RS:1;jenkins-hbase4:42829] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:03:22,781 INFO [RS:0;jenkins-hbase4:40925] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:03:22,783 INFO [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(3304): Received CLOSE for 92c2a9db2191e91acfb46b1a88e0ae3b 2023-02-07 14:03:22,783 INFO [RS:0;jenkins-hbase4:40925] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:03:22,783 INFO [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:22,783 INFO [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:22,783 DEBUG [RS:1;jenkins-hbase4:42829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61ab880b to 127.0.0.1:50760 2023-02-07 14:03:22,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 92c2a9db2191e91acfb46b1a88e0ae3b, disabling compactions & flushes 2023-02-07 14:03:22,783 DEBUG [RS:1;jenkins-hbase4:42829] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:22,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. 2023-02-07 14:03:22,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. 2023-02-07 14:03:22,783 DEBUG [RS:0;jenkins-hbase4:40925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1060ea17 to 127.0.0.1:50760 2023-02-07 14:03:22,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. after waiting 0 ms 2023-02-07 14:03:22,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. 2023-02-07 14:03:22,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 92c2a9db2191e91acfb46b1a88e0ae3b 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 14:03:22,784 INFO [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 14:03:22,784 DEBUG [RS:0;jenkins-hbase4:40925] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:22,784 DEBUG [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(1479): Online Regions={92c2a9db2191e91acfb46b1a88e0ae3b=hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b.} 2023-02-07 14:03:22,784 INFO [RS:0;jenkins-hbase4:40925] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:03:22,784 INFO [RS:0;jenkins-hbase4:40925] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:03:22,784 INFO [RS:0;jenkins-hbase4:40925] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:03:22,784 DEBUG [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(1505): Waiting on 92c2a9db2191e91acfb46b1a88e0ae3b 2023-02-07 14:03:22,784 INFO [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 14:03:22,784 INFO [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 14:03:22,784 DEBUG [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-07 14:03:22,784 DEBUG [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 14:03:22,784 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:03:22,784 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:03:22,784 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:03:22,785 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:03:22,785 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:03:22,785 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-07 14:03:22,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/namespace/92c2a9db2191e91acfb46b1a88e0ae3b/.tmp/info/620fcbe70bd944b890211986fb977550 2023-02-07 14:03:22,793 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/.tmp/info/b38f1256dee8445b8912d901ee2f78df 2023-02-07 14:03:22,796 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b38f1256dee8445b8912d901ee2f78df 2023-02-07 14:03:22,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/namespace/92c2a9db2191e91acfb46b1a88e0ae3b/.tmp/info/620fcbe70bd944b890211986fb977550 as hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/namespace/92c2a9db2191e91acfb46b1a88e0ae3b/info/620fcbe70bd944b890211986fb977550 2023-02-07 14:03:22,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/namespace/92c2a9db2191e91acfb46b1a88e0ae3b/info/620fcbe70bd944b890211986fb977550, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 14:03:22,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 92c2a9db2191e91acfb46b1a88e0ae3b in 17ms, sequenceid=6, compaction requested=false 2023-02-07 14:03:22,805 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/.tmp/rep_barrier/a84f7d2f71f14f6dbd975176c205f9e1 2023-02-07 14:03:22,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/namespace/92c2a9db2191e91acfb46b1a88e0ae3b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 14:03:22,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. 2023-02-07 14:03:22,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 92c2a9db2191e91acfb46b1a88e0ae3b: Waiting for close lock at 1675778602783Running coprocessor pre-close hooks at 1675778602783Disabling compacts and flushes for region at 1675778602783Disabling writes for close at 1675778602784 (+1 ms)Obtaining lock to block concurrent updates at 1675778602784Preparing flush snapshotting stores in 92c2a9db2191e91acfb46b1a88e0ae3b at 1675778602784Finished memstore snapshotting hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675778602784Flushing stores of hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. at 1675778602785 (+1 ms)Flushing 92c2a9db2191e91acfb46b1a88e0ae3b/info: creating writer at 1675778602785Flushing 92c2a9db2191e91acfb46b1a88e0ae3b/info: appending metadata at 1675778602787 (+2 ms)Flushing 92c2a9db2191e91acfb46b1a88e0ae3b/info: closing flushed file at 1675778602787Flushing 92c2a9db2191e91acfb46b1a88e0ae3b/info: reopening flushed file at 1675778602797 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 92c2a9db2191e91acfb46b1a88e0ae3b in 17ms, sequenceid=6, compaction requested=false at 1675778602801 (+4 ms)Writing region close event to WAL at 1675778602804 (+3 ms)Running coprocessor post-close hooks at 1675778602807 (+3 ms)Closed at 1675778602807 2023-02-07 14:03:22,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675778600349.92c2a9db2191e91acfb46b1a88e0ae3b. 2023-02-07 14:03:22,809 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a84f7d2f71f14f6dbd975176c205f9e1 2023-02-07 14:03:22,816 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/.tmp/table/8cafab8e535a45869f9c6060930c0aaf 2023-02-07 14:03:22,819 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cafab8e535a45869f9c6060930c0aaf 2023-02-07 14:03:22,820 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/.tmp/info/b38f1256dee8445b8912d901ee2f78df as hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/info/b38f1256dee8445b8912d901ee2f78df 2023-02-07 14:03:22,823 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b38f1256dee8445b8912d901ee2f78df 2023-02-07 14:03:22,823 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/info/b38f1256dee8445b8912d901ee2f78df, entries=12, sequenceid=21, filesize=6.3 K 2023-02-07 14:03:22,824 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/.tmp/rep_barrier/a84f7d2f71f14f6dbd975176c205f9e1 as hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/rep_barrier/a84f7d2f71f14f6dbd975176c205f9e1 2023-02-07 14:03:22,828 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a84f7d2f71f14f6dbd975176c205f9e1 2023-02-07 14:03:22,828 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/rep_barrier/a84f7d2f71f14f6dbd975176c205f9e1, entries=1, sequenceid=21, filesize=5.0 K 2023-02-07 14:03:22,828 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/.tmp/table/8cafab8e535a45869f9c6060930c0aaf as hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/table/8cafab8e535a45869f9c6060930c0aaf 2023-02-07 14:03:22,832 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cafab8e535a45869f9c6060930c0aaf 2023-02-07 14:03:22,832 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/table/8cafab8e535a45869f9c6060930c0aaf, entries=4, sequenceid=21, filesize=5.1 K 2023-02-07 14:03:22,835 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 50ms, sequenceid=21, compaction requested=false 2023-02-07 14:03:22,838 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-07 14:03:22,838 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 14:03:22,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:22,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778602784Running coprocessor pre-close hooks at 1675778602784Disabling compacts and flushes for region at 1675778602784Disabling writes for close at 1675778602785 (+1 ms)Obtaining lock to block concurrent updates at 1675778602785Preparing flush snapshotting stores in 1588230740 at 1675778602785Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1675778602785Flushing stores of hbase:meta,,1.1588230740 at 1675778602785Flushing 1588230740/info: creating writer at 1675778602785Flushing 1588230740/info: appending metadata at 1675778602788 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675778602788Flushing 1588230740/rep_barrier: creating writer at 1675778602796 (+8 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675778602798 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675778602798Flushing 1588230740/table: creating writer at 1675778602809 (+11 ms)Flushing 1588230740/table: appending metadata at 1675778602811 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675778602811Flushing 1588230740/info: reopening flushed file at 1675778602820 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675778602824 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1675778602829 (+5 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 50ms, sequenceid=21, compaction requested=false at 1675778602835 (+6 ms)Writing region close event to WAL at 1675778602836 (+1 ms)Running coprocessor post-close hooks at 1675778602838 (+2 ms)Closed at 1675778602839 (+1 ms) 2023-02-07 14:03:22,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:22,871 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:22,872 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:22,984 INFO [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42829,1675778599792; all regions closed. 2023-02-07 14:03:22,984 INFO [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40925,1675778599766; all regions closed. 2023-02-07 14:03:22,991 DEBUG [RS:1;jenkins-hbase4:42829] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/oldWALs 2023-02-07 14:03:22,991 INFO [RS:1;jenkins-hbase4:42829] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42829%2C1675778599792:(num 1675778600698) 2023-02-07 14:03:22,991 DEBUG [RS:1;jenkins-hbase4:42829] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:22,991 INFO [RS:1;jenkins-hbase4:42829] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:22,991 DEBUG [RS:0;jenkins-hbase4:40925] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/oldWALs 2023-02-07 14:03:22,991 INFO [RS:0;jenkins-hbase4:40925] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40925%2C1675778599766.meta:.meta(num 1675778600297) 2023-02-07 14:03:22,991 INFO [RS:1;jenkins-hbase4:42829] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 14:03:22,991 INFO [RS:1;jenkins-hbase4:42829] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:03:22,991 INFO [RS:1;jenkins-hbase4:42829] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:03:22,991 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:22,991 INFO [RS:1;jenkins-hbase4:42829] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:03:22,992 INFO [RS:1;jenkins-hbase4:42829] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42829 2023-02-07 14:03:22,994 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:22,994 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:22,994 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42829,1675778599792 2023-02-07 14:03:22,994 ERROR [Listener at localhost/43889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@49ffc1f5 rejected from java.util.concurrent.ThreadPoolExecutor@4dc05c12[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:22,994 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:22,994 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:22,994 ERROR [Listener at localhost/43889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@ec77e93 rejected from java.util.concurrent.ThreadPoolExecutor@4dc05c12[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:22,994 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42829,1675778599792] 2023-02-07 14:03:22,994 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42829,1675778599792; numProcessing=1 2023-02-07 14:03:22,995 DEBUG [RS:0;jenkins-hbase4:40925] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/oldWALs 2023-02-07 14:03:22,995 INFO [RS:0;jenkins-hbase4:40925] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40925%2C1675778599766:(num 1675778601108) 2023-02-07 14:03:22,995 DEBUG [RS:0;jenkins-hbase4:40925] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:22,995 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42829,1675778599792 already deleted, retry=false 2023-02-07 14:03:22,995 INFO [RS:0;jenkins-hbase4:40925] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:22,995 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42829,1675778599792 expired; onlineServers=1 2023-02-07 14:03:22,996 INFO [RS:0;jenkins-hbase4:40925] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 14:03:22,996 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:22,997 INFO [RS:0;jenkins-hbase4:40925] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40925 2023-02-07 14:03:23,000 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40925,1675778599766 2023-02-07 14:03:23,000 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:23,000 ERROR [Listener at localhost/43889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2479acd9 rejected from java.util.concurrent.ThreadPoolExecutor@20462c8e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:23,000 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40925,1675778599766] 2023-02-07 14:03:23,000 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40925,1675778599766; numProcessing=2 2023-02-07 14:03:23,001 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40925,1675778599766 already deleted, retry=false 2023-02-07 14:03:23,001 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40925,1675778599766 expired; onlineServers=0 2023-02-07 14:03:23,001 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,32847,1675778599716' ***** 2023-02-07 14:03:23,001 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 14:03:23,002 DEBUG [M:0;jenkins-hbase4:32847] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2db5e998, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:23,002 INFO [M:0;jenkins-hbase4:32847] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,32847,1675778599716 2023-02-07 14:03:23,002 INFO [M:0;jenkins-hbase4:32847] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,32847,1675778599716; all regions closed. 2023-02-07 14:03:23,002 DEBUG [M:0;jenkins-hbase4:32847] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:23,002 DEBUG [M:0;jenkins-hbase4:32847] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 14:03:23,002 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 14:03:23,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778599942] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778599942,5,FailOnTimeoutGroup] 2023-02-07 14:03:23,002 DEBUG [M:0;jenkins-hbase4:32847] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 14:03:23,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778599942] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778599942,5,FailOnTimeoutGroup] 2023-02-07 14:03:23,003 INFO [M:0;jenkins-hbase4:32847] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 14:03:23,004 INFO [M:0;jenkins-hbase4:32847] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 14:03:23,004 INFO [M:0;jenkins-hbase4:32847] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 14:03:23,004 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:23,004 DEBUG [M:0;jenkins-hbase4:32847] master.HMaster(1502): Stopping service threads 2023-02-07 14:03:23,004 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:23,004 INFO [M:0;jenkins-hbase4:32847] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 14:03:23,004 ERROR [M:0;jenkins-hbase4:32847] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 14:03:23,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:23,005 INFO [M:0;jenkins-hbase4:32847] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 14:03:23,005 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 14:03:23,005 DEBUG [M:0;jenkins-hbase4:32847] zookeeper.ZKUtil(398): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 14:03:23,005 WARN [M:0;jenkins-hbase4:32847] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 14:03:23,005 INFO [M:0;jenkins-hbase4:32847] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 14:03:23,006 INFO [M:0;jenkins-hbase4:32847] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 14:03:23,006 DEBUG [M:0;jenkins-hbase4:32847] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:03:23,006 INFO [M:0;jenkins-hbase4:32847] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:23,006 DEBUG [M:0;jenkins-hbase4:32847] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:23,006 DEBUG [M:0;jenkins-hbase4:32847] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:03:23,006 DEBUG [M:0;jenkins-hbase4:32847] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:23,006 INFO [M:0;jenkins-hbase4:32847] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.13 KB heapSize=67.07 KB 2023-02-07 14:03:23,018 INFO [M:0;jenkins-hbase4:32847] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.13 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7b72282da146447993a1ba7de87d2461 2023-02-07 14:03:23,021 DEBUG [M:0;jenkins-hbase4:32847] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7b72282da146447993a1ba7de87d2461 as hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7b72282da146447993a1ba7de87d2461 2023-02-07 14:03:23,025 INFO [M:0;jenkins-hbase4:32847] regionserver.HStore(1080): Added hdfs://localhost:45431/user/jenkins/test-data/60a7779d-39b4-cbb8-4a4b-46279c12ec5c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7b72282da146447993a1ba7de87d2461, entries=17, sequenceid=132, filesize=8.7 K 2023-02-07 14:03:23,025 INFO [M:0;jenkins-hbase4:32847] regionserver.HRegion(2947): Finished flush of dataSize ~56.13 KB/57482, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false 2023-02-07 14:03:23,026 INFO [M:0;jenkins-hbase4:32847] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:23,026 DEBUG [M:0;jenkins-hbase4:32847] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778603006Disabling compacts and flushes for region at 1675778603006Disabling writes for close at 1675778603006Obtaining lock to block concurrent updates at 1675778603006Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675778603006Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57482, getHeapSize=68664, getOffHeapSize=0, getCellsCount=145 at 1675778603006Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675778603007 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675778603007Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675778603009 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675778603009Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675778603022 (+13 ms)Finished flush of dataSize ~56.13 KB/57482, heapSize ~67.05 KB/68664, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false at 1675778603025 (+3 ms)Writing region close event to WAL at 1675778603026 (+1 ms)Closed at 1675778603026 2023-02-07 14:03:23,028 INFO [M:0;jenkins-hbase4:32847] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 14:03:23,028 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:23,029 INFO [M:0;jenkins-hbase4:32847] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32847 2023-02-07 14:03:23,032 DEBUG [M:0;jenkins-hbase4:32847] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,32847,1675778599716 already deleted, retry=false 2023-02-07 14:03:23,280 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:23,280 INFO [M:0;jenkins-hbase4:32847] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,32847,1675778599716; zookeeper connection closed. 2023-02-07 14:03:23,280 ERROR [Listener at localhost/43889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4701449 rejected from java.util.concurrent.ThreadPoolExecutor@4f901f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:23,281 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): master:32847-0x1002f1814d70000, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:23,281 ERROR [Listener at localhost/43889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7014f937 rejected from java.util.concurrent.ThreadPoolExecutor@4f901f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:23,380 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:23,380 INFO [RS:0;jenkins-hbase4:40925] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40925,1675778599766; zookeeper connection closed. 2023-02-07 14:03:23,380 ERROR [Listener at localhost/43889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3d9d9c03 rejected from java.util.concurrent.ThreadPoolExecutor@20462c8e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:23,381 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x1002f1814d70001, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:23,381 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@41c9bdeb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@41c9bdeb 2023-02-07 14:03:23,381 ERROR [Listener at localhost/43889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@45588452 rejected from java.util.concurrent.ThreadPoolExecutor@20462c8e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:23,481 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:23,481 INFO [RS:1;jenkins-hbase4:42829] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42829,1675778599792; zookeeper connection closed. 2023-02-07 14:03:23,481 ERROR [Listener at localhost/43889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@76ef0d29 rejected from java.util.concurrent.ThreadPoolExecutor@4dc05c12[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:23,481 DEBUG [Listener at localhost/43889-EventThread] zookeeper.ZKWatcher(600): regionserver:42829-0x1002f1814d70002, quorum=127.0.0.1:50760, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:23,481 ERROR [Listener at localhost/43889-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5debece9 rejected from java.util.concurrent.ThreadPoolExecutor@4dc05c12[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:23,481 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5f1d1c2c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5f1d1c2c 2023-02-07 14:03:23,482 INFO [Listener at localhost/43889] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 14:03:23,482 WARN [Listener at localhost/43889] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:03:23,486 INFO [Listener at localhost/43889] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:23,492 WARN [BP-750807616-172.31.14.131-1675778599082 heartbeating to localhost/127.0.0.1:45431] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 14:03:23,493 WARN [BP-750807616-172.31.14.131-1675778599082 heartbeating to localhost/127.0.0.1:45431] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-750807616-172.31.14.131-1675778599082 (Datanode Uuid 3a943684-6292-46d9-8345-f98f509acf16) service to localhost/127.0.0.1:45431 2023-02-07 14:03:23,493 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/cluster_857b5c2f-41cd-2870-638e-a1540db27280/dfs/data/data3/current/BP-750807616-172.31.14.131-1675778599082] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:23,494 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/cluster_857b5c2f-41cd-2870-638e-a1540db27280/dfs/data/data4/current/BP-750807616-172.31.14.131-1675778599082] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:23,495 WARN [Listener at localhost/43889] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:03:23,498 INFO [Listener at localhost/43889] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:23,601 WARN [BP-750807616-172.31.14.131-1675778599082 heartbeating to localhost/127.0.0.1:45431] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 14:03:23,601 WARN [BP-750807616-172.31.14.131-1675778599082 heartbeating to localhost/127.0.0.1:45431] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-750807616-172.31.14.131-1675778599082 (Datanode Uuid 9dbc8763-725c-4ad0-bf10-c944f1a09347) service to localhost/127.0.0.1:45431 2023-02-07 14:03:23,602 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/cluster_857b5c2f-41cd-2870-638e-a1540db27280/dfs/data/data1/current/BP-750807616-172.31.14.131-1675778599082] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:23,603 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/cluster_857b5c2f-41cd-2870-638e-a1540db27280/dfs/data/data2/current/BP-750807616-172.31.14.131-1675778599082] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:23,615 INFO [Listener at localhost/43889] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:23,731 INFO [Listener at localhost/43889] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 14:03:23,749 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 14:03:23,763 INFO [Listener at localhost/43889] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=251 (was 227) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:45431 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:45431 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:45431 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:45431 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43889 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45431 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:45431 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,32847,1675778599716)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:45431 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'NameNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43889.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=655 (was 638) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=273 (was 279), ProcessCount=166 (was 166), AvailableMemoryMB=5410 (was 5446) 2023-02-07 14:03:23,774 INFO [Listener at localhost/43889] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=251, OpenFileDescriptor=655, MaxFileDescriptor=60000, SystemLoadAverage=273, ProcessCount=166, AvailableMemoryMB=5409 2023-02-07 14:03:23,786 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/hadoop.log.dir so I do NOT create it in target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb 2023-02-07 14:03:23,786 WARN [Listener at localhost/43889] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 14:03:23,786 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/hadoop.tmp.dir so I do NOT create it in target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb 2023-02-07 14:03:23,786 WARN [Listener at localhost/43889] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61697b24-55d8-ec2b-3a63-b1e4b7c7ffde/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 14:03:23,786 DEBUG [Listener at localhost/43889] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb 2023-02-07 14:03:23,786 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 14:03:23,786 INFO [Listener at localhost/43889] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/cluster_d4ec39a0-82ae-0903-ed26-8de46dcefd7f, deleteOnExit=true 2023-02-07 14:03:23,786 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 14:03:23,786 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/test.cache.data in system properties and HBase conf 2023-02-07 14:03:23,786 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 14:03:23,787 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/hadoop.log.dir in system properties and HBase conf 2023-02-07 14:03:23,787 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 14:03:23,787 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 14:03:23,787 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 14:03:23,787 DEBUG [Listener at localhost/43889] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 14:03:23,787 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:03:23,787 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:03:23,787 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 14:03:23,787 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:03:23,787 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 14:03:23,788 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 14:03:23,788 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:03:23,788 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:03:23,788 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 14:03:23,788 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/nfs.dump.dir in system properties and HBase conf 2023-02-07 14:03:23,788 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/java.io.tmpdir in system properties and HBase conf 2023-02-07 14:03:23,788 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:03:23,788 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 14:03:23,788 INFO [Listener at localhost/43889] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 14:03:23,792 WARN [Listener at localhost/43889] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:03:23,793 WARN [Listener at localhost/43889] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:03:23,835 WARN [Listener at localhost/43889] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:23,837 INFO [Listener at localhost/43889] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:23,845 INFO [Listener at localhost/43889] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/java.io.tmpdir/Jetty_localhost_46413_hdfs____.cdgybm/webapp 2023-02-07 14:03:23,947 INFO [Listener at localhost/43889] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46413 2023-02-07 14:03:23,952 WARN [Listener at localhost/43889] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:03:23,952 WARN [Listener at localhost/43889] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:03:23,995 WARN [Listener at localhost/40709] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:24,018 WARN [Listener at localhost/40709] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:03:24,021 WARN [Listener at localhost/40709] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:24,022 INFO [Listener at localhost/40709] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:24,027 INFO [Listener at localhost/40709] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/java.io.tmpdir/Jetty_localhost_45307_datanode____br41q8/webapp 2023-02-07 14:03:24,123 INFO [Listener at localhost/40709] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45307 2023-02-07 14:03:24,131 WARN [Listener at localhost/38889] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:24,152 WARN [Listener at localhost/38889] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:03:24,155 WARN [Listener at localhost/38889] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:24,156 INFO [Listener at localhost/38889] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:24,159 INFO [Listener at localhost/38889] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/java.io.tmpdir/Jetty_localhost_33681_datanode____.rr011m/webapp 2023-02-07 14:03:24,247 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1231512e80329b86: Processing first storage report for DS-1d85d0ba-4190-4878-ac6a-efedee1c347a from datanode 82a25070-913e-419d-8592-297654b346c8 2023-02-07 14:03:24,247 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1231512e80329b86: from storage DS-1d85d0ba-4190-4878-ac6a-efedee1c347a node DatanodeRegistration(127.0.0.1:36291, datanodeUuid=82a25070-913e-419d-8592-297654b346c8, infoPort=46505, infoSecurePort=0, ipcPort=38889, storageInfo=lv=-57;cid=testClusterID;nsid=1282082743;c=1675778603795), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:24,247 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1231512e80329b86: Processing first storage report for DS-ad71c79a-f603-4c75-bc14-6293324eae55 from datanode 82a25070-913e-419d-8592-297654b346c8 2023-02-07 14:03:24,247 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1231512e80329b86: from storage DS-ad71c79a-f603-4c75-bc14-6293324eae55 node DatanodeRegistration(127.0.0.1:36291, datanodeUuid=82a25070-913e-419d-8592-297654b346c8, infoPort=46505, infoSecurePort=0, ipcPort=38889, storageInfo=lv=-57;cid=testClusterID;nsid=1282082743;c=1675778603795), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:24,284 INFO [Listener at localhost/38889] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33681 2023-02-07 14:03:24,294 WARN [Listener at localhost/35907] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:24,408 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6ce2cbb3466f7465: Processing first storage report for DS-ceed2565-250f-40bc-a2d0-232d644770c0 from datanode 33672e60-aa7c-4b61-97d2-580c7cbab655 2023-02-07 14:03:24,408 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6ce2cbb3466f7465: from storage DS-ceed2565-250f-40bc-a2d0-232d644770c0 node DatanodeRegistration(127.0.0.1:42053, datanodeUuid=33672e60-aa7c-4b61-97d2-580c7cbab655, infoPort=37171, infoSecurePort=0, ipcPort=35907, storageInfo=lv=-57;cid=testClusterID;nsid=1282082743;c=1675778603795), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:24,408 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6ce2cbb3466f7465: Processing first storage report for DS-1314e920-f15b-4177-bc1c-d4854be40e32 from datanode 33672e60-aa7c-4b61-97d2-580c7cbab655 2023-02-07 14:03:24,408 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6ce2cbb3466f7465: from storage DS-1314e920-f15b-4177-bc1c-d4854be40e32 node DatanodeRegistration(127.0.0.1:42053, datanodeUuid=33672e60-aa7c-4b61-97d2-580c7cbab655, infoPort=37171, infoSecurePort=0, ipcPort=35907, storageInfo=lv=-57;cid=testClusterID;nsid=1282082743;c=1675778603795), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:24,428 DEBUG [Listener at localhost/35907] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb 2023-02-07 14:03:24,430 INFO [Listener at localhost/35907] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/cluster_d4ec39a0-82ae-0903-ed26-8de46dcefd7f/zookeeper_0, clientPort=50027, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/cluster_d4ec39a0-82ae-0903-ed26-8de46dcefd7f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/cluster_d4ec39a0-82ae-0903-ed26-8de46dcefd7f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 14:03:24,431 INFO [Listener at localhost/35907] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50027 2023-02-07 14:03:24,432 INFO [Listener at localhost/35907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:24,433 INFO [Listener at localhost/35907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:24,448 INFO [Listener at localhost/35907] util.FSUtils(479): Created version file at hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16 with version=8 2023-02-07 14:03:24,448 INFO [Listener at localhost/35907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:24,449 INFO [Listener at localhost/35907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:24,450 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40709/user/jenkins/test-data/6b53dd89-0db8-c3aa-618f-7cc905481d06/hbase-staging 2023-02-07 14:03:24,452 INFO [Listener at localhost/35907] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:24,453 INFO [Listener at localhost/35907] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:24,453 INFO [Listener at localhost/35907] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:24,453 INFO [Listener at localhost/35907] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:24,453 INFO [Listener at localhost/35907] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:24,453 INFO [Listener at localhost/35907] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:24,453 INFO [Listener at localhost/35907] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:24,454 INFO [Listener at localhost/35907] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45073 2023-02-07 14:03:24,455 INFO [Listener at localhost/35907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:24,456 INFO [Listener at localhost/35907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:24,457 INFO [Listener at localhost/35907] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45073 connecting to ZooKeeper ensemble=127.0.0.1:50027 2023-02-07 14:03:24,468 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:450730x0, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:24,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45073-0x1002f1827530000 connected 2023-02-07 14:03:24,484 DEBUG [Listener at localhost/35907] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:24,484 DEBUG [Listener at localhost/35907] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:24,485 DEBUG [Listener at localhost/35907] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:24,488 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45073 2023-02-07 14:03:24,488 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45073 2023-02-07 14:03:24,488 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45073 2023-02-07 14:03:24,490 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45073 2023-02-07 14:03:24,492 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45073 2023-02-07 14:03:24,492 INFO [Listener at localhost/35907] master.HMaster(439): hbase.rootdir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16, hbase.cluster.distributed=false 2023-02-07 14:03:24,509 INFO [Listener at localhost/35907] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:24,509 INFO [Listener at localhost/35907] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:24,509 INFO [Listener at localhost/35907] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:24,510 INFO [Listener at localhost/35907] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:24,510 INFO [Listener at localhost/35907] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:24,510 INFO [Listener at localhost/35907] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:24,510 INFO [Listener at localhost/35907] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:24,511 INFO [Listener at localhost/35907] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40217 2023-02-07 14:03:24,512 INFO [Listener at localhost/35907] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:03:24,516 DEBUG [Listener at localhost/35907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:24,517 INFO [Listener at localhost/35907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:24,518 INFO [Listener at localhost/35907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:24,521 INFO [Listener at localhost/35907] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40217 connecting to ZooKeeper ensemble=127.0.0.1:50027 2023-02-07 14:03:24,525 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:402170x0, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:24,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40217-0x1002f1827530001 connected 2023-02-07 14:03:24,526 DEBUG [Listener at localhost/35907] zookeeper.ZKUtil(164): regionserver:402170x0, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:24,527 DEBUG [Listener at localhost/35907] zookeeper.ZKUtil(164): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:24,527 DEBUG [Listener at localhost/35907] zookeeper.ZKUtil(164): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:24,531 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40217 2023-02-07 14:03:24,532 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40217 2023-02-07 14:03:24,532 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40217 2023-02-07 14:03:24,536 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40217 2023-02-07 14:03:24,540 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40217 2023-02-07 14:03:24,557 INFO [Listener at localhost/35907] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:24,557 INFO [Listener at localhost/35907] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:24,557 INFO [Listener at localhost/35907] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:24,557 INFO [Listener at localhost/35907] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:24,557 INFO [Listener at localhost/35907] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:24,558 INFO [Listener at localhost/35907] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:24,558 INFO [Listener at localhost/35907] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:24,560 INFO [Listener at localhost/35907] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35119 2023-02-07 14:03:24,560 INFO [Listener at localhost/35907] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:03:24,561 DEBUG [Listener at localhost/35907] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:24,561 INFO [Listener at localhost/35907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:24,562 INFO [Listener at localhost/35907] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:24,563 INFO [Listener at localhost/35907] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35119 connecting to ZooKeeper ensemble=127.0.0.1:50027 2023-02-07 14:03:24,566 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:351190x0, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:24,566 DEBUG [Listener at localhost/35907] zookeeper.ZKUtil(164): regionserver:351190x0, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:24,567 DEBUG [Listener at localhost/35907] zookeeper.ZKUtil(164): regionserver:351190x0, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:24,567 DEBUG [Listener at localhost/35907] zookeeper.ZKUtil(164): regionserver:351190x0, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:24,569 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35119-0x1002f1827530002 connected 2023-02-07 14:03:24,570 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35119 2023-02-07 14:03:24,572 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35119 2023-02-07 14:03:24,574 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35119 2023-02-07 14:03:24,579 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35119 2023-02-07 14:03:24,579 DEBUG [Listener at localhost/35907] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35119 2023-02-07 14:03:24,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45073,1675778604452 2023-02-07 14:03:24,583 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:03:24,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45073,1675778604452 2023-02-07 14:03:24,585 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:24,585 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:24,585 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:24,585 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:24,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:03:24,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:03:24,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45073,1675778604452 from backup master directory 2023-02-07 14:03:24,590 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45073,1675778604452 2023-02-07 14:03:24,590 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:03:24,591 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:24,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,45073,1675778604452 2023-02-07 14:03:25,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/hbase.id with ID: 33777f6a-6316-4387-80c2-aff849ef3e04 2023-02-07 14:03:25,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:25,025 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:25,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x05c6d27e to 127.0.0.1:50027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:25,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bc24de0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:25,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:25,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 14:03:25,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:25,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/MasterData/data/master/store-tmp 2023-02-07 14:03:25,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:25,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:03:25,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:25,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:25,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:03:25,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:25,043 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:25,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778605043Disabling compacts and flushes for region at 1675778605043Disabling writes for close at 1675778605043Writing region close event to WAL at 1675778605043Closed at 1675778605043 2023-02-07 14:03:25,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/MasterData/WALs/jenkins-hbase4.apache.org,45073,1675778604452 2023-02-07 14:03:25,046 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45073%2C1675778604452, suffix=, logDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/MasterData/WALs/jenkins-hbase4.apache.org,45073,1675778604452, archiveDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/MasterData/oldWALs, maxLogs=10 2023-02-07 14:03:25,058 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36291,DS-1d85d0ba-4190-4878-ac6a-efedee1c347a,DISK] 2023-02-07 14:03:25,058 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42053,DS-ceed2565-250f-40bc-a2d0-232d644770c0,DISK] 2023-02-07 14:03:25,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/MasterData/WALs/jenkins-hbase4.apache.org,45073,1675778604452/jenkins-hbase4.apache.org%2C45073%2C1675778604452.1675778605046 2023-02-07 14:03:25,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36291,DS-1d85d0ba-4190-4878-ac6a-efedee1c347a,DISK], DatanodeInfoWithStorage[127.0.0.1:42053,DS-ceed2565-250f-40bc-a2d0-232d644770c0,DISK]] 2023-02-07 14:03:25,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:25,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:25,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:25,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:25,062 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:25,064 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 14:03:25,064 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 14:03:25,064 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:25,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:25,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:25,067 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:25,069 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:25,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71193493, jitterRate=0.06086571514606476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:03:25,069 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675778605062Initializing all the Stores at 1675778605062Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778605062Cleaning up temporary data from old regions at 1675778605066 (+4 ms)Cleaning up detritus from prior splits at 1675778605066Region opened successfully at 1675778605069 (+3 ms) 2023-02-07 14:03:25,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 14:03:25,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 14:03:25,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 14:03:25,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 14:03:25,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 14:03:25,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 14:03:25,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 14:03:25,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 14:03:25,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 14:03:25,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 14:03:25,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 14:03:25,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 14:03:25,084 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 14:03:25,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 14:03:25,086 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:25,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 14:03:25,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 14:03:25,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 14:03:25,090 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:25,090 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:25,090 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:25,090 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:25,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,45073,1675778604452, sessionid=0x1002f1827530000, setting cluster-up flag (Was=false) 2023-02-07 14:03:25,096 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:25,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 14:03:25,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45073,1675778604452 2023-02-07 14:03:25,103 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:25,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 14:03:25,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45073,1675778604452 2023-02-07 14:03:25,108 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.hbase-snapshot/.tmp 2023-02-07 14:03:25,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:25,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:25,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:25,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:25,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:25,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 14:03:25,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:25,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675778635112 2023-02-07 14:03:25,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 14:03:25,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 14:03:25,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 14:03:25,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 14:03:25,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 14:03:25,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 14:03:25,113 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:25,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,113 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 14:03:25,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 14:03:25,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 14:03:25,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 14:03:25,115 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:25,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 14:03:25,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 14:03:25,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778605121,5,FailOnTimeoutGroup] 2023-02-07 14:03:25,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778605121,5,FailOnTimeoutGroup] 2023-02-07 14:03:25,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 14:03:25,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,121 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,130 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:25,131 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:25,131 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16 2023-02-07 14:03:25,139 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:25,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:03:25,141 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/info 2023-02-07 14:03:25,142 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:03:25,142 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:25,142 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:03:25,143 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:25,143 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:03:25,144 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:25,144 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:03:25,145 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/table 2023-02-07 14:03:25,145 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:03:25,145 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:25,146 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740 2023-02-07 14:03:25,146 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740 2023-02-07 14:03:25,148 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:03:25,149 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:03:25,150 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:25,151 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72434199, jitterRate=0.07935367524623871}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:03:25,151 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675778605139Initializing all the Stores at 1675778605140 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778605140Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778605140Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778605140Cleaning up temporary data from old regions at 1675778605147 (+7 ms)Cleaning up detritus from prior splits at 1675778605147Region opened successfully at 1675778605151 (+4 ms) 2023-02-07 14:03:25,151 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:03:25,151 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:03:25,151 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:03:25,151 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:03:25,151 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:03:25,151 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:25,151 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778605151Disabling compacts and flushes for region at 1675778605151Disabling writes for close at 1675778605151Writing region close event to WAL at 1675778605151Closed at 1675778605151 2023-02-07 14:03:25,152 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:25,152 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 14:03:25,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 14:03:25,154 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 14:03:25,155 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 14:03:25,182 INFO [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(952): ClusterId : 33777f6a-6316-4387-80c2-aff849ef3e04 2023-02-07 14:03:25,182 INFO [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(952): ClusterId : 33777f6a-6316-4387-80c2-aff849ef3e04 2023-02-07 14:03:25,182 DEBUG [RS:0;jenkins-hbase4:40217] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:03:25,183 DEBUG [RS:1;jenkins-hbase4:35119] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:03:25,184 DEBUG [RS:1;jenkins-hbase4:35119] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:03:25,184 DEBUG [RS:1;jenkins-hbase4:35119] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:03:25,184 DEBUG [RS:0;jenkins-hbase4:40217] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:03:25,184 DEBUG [RS:0;jenkins-hbase4:40217] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:03:25,188 DEBUG [RS:1;jenkins-hbase4:35119] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:03:25,189 DEBUG [RS:1;jenkins-hbase4:35119] zookeeper.ReadOnlyZKClient(139): Connect 0x785b7910 to 127.0.0.1:50027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:25,189 DEBUG [RS:0;jenkins-hbase4:40217] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:03:25,190 DEBUG [RS:0;jenkins-hbase4:40217] zookeeper.ReadOnlyZKClient(139): Connect 0x418bced7 to 127.0.0.1:50027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:25,193 DEBUG [RS:1;jenkins-hbase4:35119] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@769c886b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:25,193 DEBUG [RS:1;jenkins-hbase4:35119] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72a31260, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:25,196 DEBUG [RS:0;jenkins-hbase4:40217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f4c2896, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:25,196 DEBUG [RS:0;jenkins-hbase4:40217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b73a5a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:25,203 DEBUG [RS:1;jenkins-hbase4:35119] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35119 2023-02-07 14:03:25,203 INFO [RS:1;jenkins-hbase4:35119] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:03:25,203 INFO [RS:1;jenkins-hbase4:35119] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:03:25,203 DEBUG [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:03:25,204 DEBUG [RS:0;jenkins-hbase4:40217] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40217 2023-02-07 14:03:25,204 INFO [RS:0;jenkins-hbase4:40217] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:03:25,204 INFO [RS:0;jenkins-hbase4:40217] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:03:25,204 INFO [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45073,1675778604452 with isa=jenkins-hbase4.apache.org/172.31.14.131:35119, startcode=1675778604556 2023-02-07 14:03:25,204 DEBUG [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:03:25,204 DEBUG [RS:1;jenkins-hbase4:35119] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:03:25,204 INFO [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45073,1675778604452 with isa=jenkins-hbase4.apache.org/172.31.14.131:40217, startcode=1675778604509 2023-02-07 14:03:25,204 DEBUG [RS:0;jenkins-hbase4:40217] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:03:25,206 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57861, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:03:25,206 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59855, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:03:25,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45073] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:25,208 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:25,209 DEBUG [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16 2023-02-07 14:03:25,209 DEBUG [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40709 2023-02-07 14:03:25,209 DEBUG [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:03:25,209 DEBUG [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16 2023-02-07 14:03:25,209 DEBUG [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:40709 2023-02-07 14:03:25,209 DEBUG [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:03:25,212 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:25,215 DEBUG [RS:1;jenkins-hbase4:35119] zookeeper.ZKUtil(162): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:25,215 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40217,1675778604509] 2023-02-07 14:03:25,215 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35119,1675778604556] 2023-02-07 14:03:25,215 WARN [RS:1;jenkins-hbase4:35119] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:25,215 DEBUG [RS:0;jenkins-hbase4:40217] zookeeper.ZKUtil(162): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:25,215 INFO [RS:1;jenkins-hbase4:35119] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:25,215 WARN [RS:0;jenkins-hbase4:40217] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:25,215 DEBUG [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/WALs/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:25,215 INFO [RS:0;jenkins-hbase4:40217] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:25,215 DEBUG [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(1947): logDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/WALs/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:25,224 DEBUG [RS:0;jenkins-hbase4:40217] zookeeper.ZKUtil(162): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:25,224 DEBUG [RS:1;jenkins-hbase4:35119] zookeeper.ZKUtil(162): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:25,225 DEBUG [RS:0;jenkins-hbase4:40217] zookeeper.ZKUtil(162): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:25,225 DEBUG [RS:1;jenkins-hbase4:35119] zookeeper.ZKUtil(162): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:25,225 DEBUG [RS:1;jenkins-hbase4:35119] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:03:25,225 DEBUG [RS:0;jenkins-hbase4:40217] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:03:25,226 INFO [RS:0;jenkins-hbase4:40217] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:03:25,226 INFO [RS:1;jenkins-hbase4:35119] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:03:25,232 INFO [RS:0;jenkins-hbase4:40217] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:03:25,232 INFO [RS:1;jenkins-hbase4:35119] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:03:25,232 INFO [RS:0;jenkins-hbase4:40217] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:03:25,232 INFO [RS:0;jenkins-hbase4:40217] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,236 INFO [RS:1;jenkins-hbase4:35119] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:03:25,236 INFO [RS:1;jenkins-hbase4:35119] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,240 INFO [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:03:25,240 INFO [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:03:25,242 INFO [RS:1;jenkins-hbase4:35119] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,242 INFO [RS:0;jenkins-hbase4:40217] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,243 DEBUG [RS:1;jenkins-hbase4:35119] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,243 DEBUG [RS:1;jenkins-hbase4:35119] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,243 DEBUG [RS:0;jenkins-hbase4:40217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,243 DEBUG [RS:1;jenkins-hbase4:35119] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:0;jenkins-hbase4:40217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:1;jenkins-hbase4:35119] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:0;jenkins-hbase4:40217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:1;jenkins-hbase4:35119] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:0;jenkins-hbase4:40217] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:1;jenkins-hbase4:35119] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:25,244 DEBUG [RS:0;jenkins-hbase4:40217] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:1;jenkins-hbase4:35119] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:0;jenkins-hbase4:40217] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:25,244 DEBUG [RS:1;jenkins-hbase4:35119] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:0;jenkins-hbase4:40217] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:1;jenkins-hbase4:35119] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:0;jenkins-hbase4:40217] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:1;jenkins-hbase4:35119] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:0;jenkins-hbase4:40217] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,244 DEBUG [RS:0;jenkins-hbase4:40217] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:25,251 INFO [RS:1;jenkins-hbase4:35119] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,251 INFO [RS:0;jenkins-hbase4:40217] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,251 INFO [RS:1;jenkins-hbase4:35119] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,251 INFO [RS:0;jenkins-hbase4:40217] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,251 INFO [RS:1;jenkins-hbase4:35119] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,251 INFO [RS:0;jenkins-hbase4:40217] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,262 INFO [RS:1;jenkins-hbase4:35119] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:03:25,263 INFO [RS:1;jenkins-hbase4:35119] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35119,1675778604556-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,267 INFO [RS:0;jenkins-hbase4:40217] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:03:25,268 INFO [RS:0;jenkins-hbase4:40217] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40217,1675778604509-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,278 INFO [RS:1;jenkins-hbase4:35119] regionserver.Replication(203): jenkins-hbase4.apache.org,35119,1675778604556 started 2023-02-07 14:03:25,278 INFO [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35119,1675778604556, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35119, sessionid=0x1002f1827530002 2023-02-07 14:03:25,278 DEBUG [RS:1;jenkins-hbase4:35119] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:03:25,278 DEBUG [RS:1;jenkins-hbase4:35119] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:25,278 DEBUG [RS:1;jenkins-hbase4:35119] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35119,1675778604556' 2023-02-07 14:03:25,278 DEBUG [RS:1;jenkins-hbase4:35119] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:25,279 DEBUG [RS:1;jenkins-hbase4:35119] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:25,279 DEBUG [RS:1;jenkins-hbase4:35119] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:03:25,279 DEBUG [RS:1;jenkins-hbase4:35119] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:03:25,279 DEBUG [RS:1;jenkins-hbase4:35119] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:25,279 DEBUG [RS:1;jenkins-hbase4:35119] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35119,1675778604556' 2023-02-07 14:03:25,279 DEBUG [RS:1;jenkins-hbase4:35119] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:25,280 DEBUG [RS:1;jenkins-hbase4:35119] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:25,280 DEBUG [RS:1;jenkins-hbase4:35119] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:03:25,280 INFO [RS:1;jenkins-hbase4:35119] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:03:25,280 INFO [RS:1;jenkins-hbase4:35119] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:03:25,288 INFO [RS:0;jenkins-hbase4:40217] regionserver.Replication(203): jenkins-hbase4.apache.org,40217,1675778604509 started 2023-02-07 14:03:25,288 INFO [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40217,1675778604509, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40217, sessionid=0x1002f1827530001 2023-02-07 14:03:25,288 DEBUG [RS:0;jenkins-hbase4:40217] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:03:25,288 DEBUG [RS:0;jenkins-hbase4:40217] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:25,288 DEBUG [RS:0;jenkins-hbase4:40217] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40217,1675778604509' 2023-02-07 14:03:25,288 DEBUG [RS:0;jenkins-hbase4:40217] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:25,288 DEBUG [RS:0;jenkins-hbase4:40217] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:25,289 DEBUG [RS:0;jenkins-hbase4:40217] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:03:25,289 DEBUG [RS:0;jenkins-hbase4:40217] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:03:25,289 DEBUG [RS:0;jenkins-hbase4:40217] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:25,289 DEBUG [RS:0;jenkins-hbase4:40217] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40217,1675778604509' 2023-02-07 14:03:25,289 DEBUG [RS:0;jenkins-hbase4:40217] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:25,289 DEBUG [RS:0;jenkins-hbase4:40217] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:25,289 DEBUG [RS:0;jenkins-hbase4:40217] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:03:25,289 INFO [RS:0;jenkins-hbase4:40217] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:03:25,289 INFO [RS:0;jenkins-hbase4:40217] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:03:25,306 DEBUG [jenkins-hbase4:45073] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 14:03:25,306 DEBUG [jenkins-hbase4:45073] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:25,307 DEBUG [jenkins-hbase4:45073] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:25,307 DEBUG [jenkins-hbase4:45073] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:25,307 DEBUG [jenkins-hbase4:45073] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:25,307 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40217,1675778604509, state=OPENING 2023-02-07 14:03:25,309 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 14:03:25,311 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:25,312 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:03:25,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40217,1675778604509}] 2023-02-07 14:03:25,467 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:25,467 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 14:03:25,469 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59912, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 14:03:25,474 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 14:03:25,474 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:25,475 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40217%2C1675778604509.meta, suffix=.meta, logDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/WALs/jenkins-hbase4.apache.org,40217,1675778604509, archiveDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/oldWALs, maxLogs=32 2023-02-07 14:03:25,491 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42053,DS-ceed2565-250f-40bc-a2d0-232d644770c0,DISK] 2023-02-07 14:03:25,492 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36291,DS-1d85d0ba-4190-4878-ac6a-efedee1c347a,DISK] 2023-02-07 14:03:25,494 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/WALs/jenkins-hbase4.apache.org,40217,1675778604509/jenkins-hbase4.apache.org%2C40217%2C1675778604509.meta.1675778605476.meta 2023-02-07 14:03:25,494 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42053,DS-ceed2565-250f-40bc-a2d0-232d644770c0,DISK], DatanodeInfoWithStorage[127.0.0.1:36291,DS-1d85d0ba-4190-4878-ac6a-efedee1c347a,DISK]] 2023-02-07 14:03:25,494 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:25,494 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 14:03:25,494 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 14:03:25,494 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 14:03:25,494 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 14:03:25,494 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:25,494 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 14:03:25,494 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 14:03:25,495 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:03:25,497 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/info 2023-02-07 14:03:25,497 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/info 2023-02-07 14:03:25,497 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:03:25,497 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:25,497 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:03:25,498 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:25,498 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:25,499 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:03:25,499 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:25,499 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:03:25,500 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/table 2023-02-07 14:03:25,500 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/table 2023-02-07 14:03:25,500 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:03:25,501 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:25,501 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740 2023-02-07 14:03:25,502 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740 2023-02-07 14:03:25,504 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:03:25,505 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:03:25,505 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58972510, jitterRate=-0.12124112248420715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:03:25,505 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675778605495Writing region info on filesystem at 1675778605495Initializing all the Stores at 1675778605495Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778605495Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778605495Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778605495Cleaning up temporary data from old regions at 1675778605503 (+8 ms)Cleaning up detritus from prior splits at 1675778605503Running coprocessor post-open hooks at 1675778605505 (+2 ms)Region opened successfully at 1675778605505 2023-02-07 14:03:25,506 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675778605467 2023-02-07 14:03:25,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 14:03:25,513 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 14:03:25,513 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40217,1675778604509, state=OPEN 2023-02-07 14:03:25,514 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 14:03:25,514 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:03:25,516 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 14:03:25,516 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40217,1675778604509 in 202 msec 2023-02-07 14:03:25,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 14:03:25,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 364 msec 2023-02-07 14:03:25,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 408 msec 2023-02-07 14:03:25,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675778604583, completionTime=-1 2023-02-07 14:03:25,518 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 14:03:25,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 14:03:25,519 DEBUG [hconnection-0x125a32f2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:25,521 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59922, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:25,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 14:03:25,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675778665523 2023-02-07 14:03:25,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675778725523 2023-02-07 14:03:25,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-07 14:03:25,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45073,1675778604452-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45073,1675778604452-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45073,1675778604452-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45073, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:25,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 14:03:25,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:25,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 14:03:25,534 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 14:03:25,534 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:03:25,535 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:03:25,536 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/hbase/namespace/b50ca9fc180460a6233dec81ca4aaf34 2023-02-07 14:03:25,536 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/hbase/namespace/b50ca9fc180460a6233dec81ca4aaf34 empty. 2023-02-07 14:03:25,537 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/hbase/namespace/b50ca9fc180460a6233dec81ca4aaf34 2023-02-07 14:03:25,537 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 14:03:25,547 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:25,548 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => b50ca9fc180460a6233dec81ca4aaf34, NAME => 'hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp 2023-02-07 14:03:25,554 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:25,554 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing b50ca9fc180460a6233dec81ca4aaf34, disabling compactions & flushes 2023-02-07 14:03:25,554 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. 2023-02-07 14:03:25,554 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. 2023-02-07 14:03:25,554 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. after waiting 0 ms 2023-02-07 14:03:25,554 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. 2023-02-07 14:03:25,554 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. 2023-02-07 14:03:25,554 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for b50ca9fc180460a6233dec81ca4aaf34: Waiting for close lock at 1675778605554Disabling compacts and flushes for region at 1675778605554Disabling writes for close at 1675778605554Writing region close event to WAL at 1675778605554Closed at 1675778605554 2023-02-07 14:03:25,556 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:03:25,557 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778605556"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778605556"}]},"ts":"1675778605556"} 2023-02-07 14:03:25,558 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 14:03:25,558 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:03:25,559 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778605558"}]},"ts":"1675778605558"} 2023-02-07 14:03:25,560 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 14:03:25,563 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:25,564 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:25,564 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:25,564 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:25,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b50ca9fc180460a6233dec81ca4aaf34, ASSIGN}] 2023-02-07 14:03:25,566 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b50ca9fc180460a6233dec81ca4aaf34, ASSIGN 2023-02-07 14:03:25,567 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b50ca9fc180460a6233dec81ca4aaf34, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35119,1675778604556; forceNewPlan=false, retain=false 2023-02-07 14:03:25,717 INFO [jenkins-hbase4:45073] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 14:03:25,718 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b50ca9fc180460a6233dec81ca4aaf34, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:25,718 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778605718"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778605718"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778605718"}]},"ts":"1675778605718"} 2023-02-07 14:03:25,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b50ca9fc180460a6233dec81ca4aaf34, server=jenkins-hbase4.apache.org,35119,1675778604556}] 2023-02-07 14:03:25,817 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 14:03:25,872 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:25,873 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 14:03:25,875 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58422, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 14:03:25,881 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. 2023-02-07 14:03:25,884 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35119%2C1675778604556, suffix=, logDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/WALs/jenkins-hbase4.apache.org,35119,1675778604556, archiveDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/oldWALs, maxLogs=32 2023-02-07 14:03:25,899 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42053,DS-ceed2565-250f-40bc-a2d0-232d644770c0,DISK] 2023-02-07 14:03:25,899 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36291,DS-1d85d0ba-4190-4878-ac6a-efedee1c347a,DISK] 2023-02-07 14:03:25,902 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/WALs/jenkins-hbase4.apache.org,35119,1675778604556/jenkins-hbase4.apache.org%2C35119%2C1675778604556.1675778605884 2023-02-07 14:03:25,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42053,DS-ceed2565-250f-40bc-a2d0-232d644770c0,DISK], DatanodeInfoWithStorage[127.0.0.1:36291,DS-1d85d0ba-4190-4878-ac6a-efedee1c347a,DISK]] 2023-02-07 14:03:25,904 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b50ca9fc180460a6233dec81ca4aaf34, NAME => 'hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:25,904 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b50ca9fc180460a6233dec81ca4aaf34 2023-02-07 14:03:25,904 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:25,904 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b50ca9fc180460a6233dec81ca4aaf34 2023-02-07 14:03:25,904 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b50ca9fc180460a6233dec81ca4aaf34 2023-02-07 14:03:25,906 INFO [StoreOpener-b50ca9fc180460a6233dec81ca4aaf34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b50ca9fc180460a6233dec81ca4aaf34 2023-02-07 14:03:25,908 DEBUG [StoreOpener-b50ca9fc180460a6233dec81ca4aaf34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/namespace/b50ca9fc180460a6233dec81ca4aaf34/info 2023-02-07 14:03:25,908 DEBUG [StoreOpener-b50ca9fc180460a6233dec81ca4aaf34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/namespace/b50ca9fc180460a6233dec81ca4aaf34/info 2023-02-07 14:03:25,909 INFO [StoreOpener-b50ca9fc180460a6233dec81ca4aaf34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b50ca9fc180460a6233dec81ca4aaf34 columnFamilyName info 2023-02-07 14:03:25,909 INFO [StoreOpener-b50ca9fc180460a6233dec81ca4aaf34-1] regionserver.HStore(310): Store=b50ca9fc180460a6233dec81ca4aaf34/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:25,910 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/namespace/b50ca9fc180460a6233dec81ca4aaf34 2023-02-07 14:03:25,910 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/namespace/b50ca9fc180460a6233dec81ca4aaf34 2023-02-07 14:03:25,913 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b50ca9fc180460a6233dec81ca4aaf34 2023-02-07 14:03:25,918 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/namespace/b50ca9fc180460a6233dec81ca4aaf34/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:25,919 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b50ca9fc180460a6233dec81ca4aaf34; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62067507, jitterRate=-0.07512207329273224}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:03:25,919 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b50ca9fc180460a6233dec81ca4aaf34: Running coprocessor pre-open hook at 1675778605904Writing region info on filesystem at 1675778605904Initializing all the Stores at 1675778605905 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778605905Cleaning up temporary data from old regions at 1675778605911 (+6 ms)Cleaning up detritus from prior splits at 1675778605911Running coprocessor post-open hooks at 1675778605919 (+8 ms)Region opened successfully at 1675778605919 2023-02-07 14:03:25,920 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34., pid=6, masterSystemTime=1675778605872 2023-02-07 14:03:25,922 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. 2023-02-07 14:03:25,923 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. 2023-02-07 14:03:25,923 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b50ca9fc180460a6233dec81ca4aaf34, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:25,924 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778605923"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778605923"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778605923"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778605923"}]},"ts":"1675778605923"} 2023-02-07 14:03:25,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 14:03:25,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b50ca9fc180460a6233dec81ca4aaf34, server=jenkins-hbase4.apache.org,35119,1675778604556 in 205 msec 2023-02-07 14:03:25,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 14:03:25,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b50ca9fc180460a6233dec81ca4aaf34, ASSIGN in 363 msec 2023-02-07 14:03:25,929 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:03:25,929 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778605929"}]},"ts":"1675778605929"} 2023-02-07 14:03:25,931 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 14:03:25,934 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:03:25,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 14:03:25,936 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:25,936 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:25,937 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 402 msec 2023-02-07 14:03:25,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:25,945 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58428, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:25,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 14:03:25,958 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:25,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 15 msec 2023-02-07 14:03:25,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 14:03:25,975 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:25,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-07 14:03:25,983 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 14:03:25,985 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 14:03:25,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.394sec 2023-02-07 14:03:25,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 14:03:25,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 14:03:25,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 14:03:25,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45073,1675778604452-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 14:03:25,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45073,1675778604452-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 14:03:25,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 14:03:26,083 DEBUG [Listener at localhost/35907] zookeeper.ReadOnlyZKClient(139): Connect 0x69f4141a to 127.0.0.1:50027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:26,086 DEBUG [Listener at localhost/35907] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@462a59dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:26,087 DEBUG [hconnection-0x1762f485-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:26,089 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59934, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:26,090 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45073,1675778604452 2023-02-07 14:03:26,090 DEBUG [Listener at localhost/35907] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 14:03:26,090 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:26,090 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:26,093 DEBUG [Listener at localhost/35907] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 14:03:26,094 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44914, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 14:03:26,095 INFO [Listener at localhost/35907] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:26,095 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:26,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 14:03:26,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 105 connection: 172.31.14.131:44914 deadline: 1675778666095, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:26,095 INFO [Listener at localhost/35907] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-07 14:03:26,096 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:26,096 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:26,098 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:26,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:26,100 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:03:26,100 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-07 14:03:26,100 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:26,100 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:26,100 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:03:26,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:26,102 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:26,102 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547 empty. 2023-02-07 14:03:26,103 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:26,103 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-07 14:03:26,114 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:26,115 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 25a1fc9d07cc28733535a08a7e0ef547, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp 2023-02-07 14:03:26,122 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:26,122 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 25a1fc9d07cc28733535a08a7e0ef547, disabling compactions & flushes 2023-02-07 14:03:26,122 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:26,122 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:26,122 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. after waiting 0 ms 2023-02-07 14:03:26,122 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:26,122 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:26,122 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 25a1fc9d07cc28733535a08a7e0ef547: Waiting for close lock at 1675778606122Disabling compacts and flushes for region at 1675778606122Disabling writes for close at 1675778606122Writing region close event to WAL at 1675778606122Closed at 1675778606122 2023-02-07 14:03:26,124 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:03:26,125 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675778606125"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778606125"}]},"ts":"1675778606125"} 2023-02-07 14:03:26,126 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 14:03:26,126 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:03:26,127 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778606126"}]},"ts":"1675778606126"} 2023-02-07 14:03:26,127 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-07 14:03:26,134 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:26,135 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:26,135 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:26,135 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:26,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=25a1fc9d07cc28733535a08a7e0ef547, ASSIGN}] 2023-02-07 14:03:26,137 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=25a1fc9d07cc28733535a08a7e0ef547, ASSIGN 2023-02-07 14:03:26,138 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=25a1fc9d07cc28733535a08a7e0ef547, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40217,1675778604509; forceNewPlan=false, retain=false 2023-02-07 14:03:26,201 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:26,202 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:26,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:26,288 INFO [jenkins-hbase4:45073] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 14:03:26,288 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=25a1fc9d07cc28733535a08a7e0ef547, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,289 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675778606288"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778606288"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778606288"}]},"ts":"1675778606288"} 2023-02-07 14:03:26,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 25a1fc9d07cc28733535a08a7e0ef547, server=jenkins-hbase4.apache.org,40217,1675778604509}] 2023-02-07 14:03:26,291 INFO [RS:0;jenkins-hbase4:40217] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40217%2C1675778604509, suffix=, logDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/WALs/jenkins-hbase4.apache.org,40217,1675778604509, archiveDir=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/oldWALs, maxLogs=32 2023-02-07 14:03:26,305 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36291,DS-1d85d0ba-4190-4878-ac6a-efedee1c347a,DISK] 2023-02-07 14:03:26,305 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42053,DS-ceed2565-250f-40bc-a2d0-232d644770c0,DISK] 2023-02-07 14:03:26,306 INFO [RS:0;jenkins-hbase4:40217] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/WALs/jenkins-hbase4.apache.org,40217,1675778604509/jenkins-hbase4.apache.org%2C40217%2C1675778604509.1675778606292 2023-02-07 14:03:26,307 DEBUG [RS:0;jenkins-hbase4:40217] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36291,DS-1d85d0ba-4190-4878-ac6a-efedee1c347a,DISK], DatanodeInfoWithStorage[127.0.0.1:42053,DS-ceed2565-250f-40bc-a2d0-232d644770c0,DISK]] 2023-02-07 14:03:26,403 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:26,403 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:26,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:26,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:26,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 25a1fc9d07cc28733535a08a7e0ef547, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:26,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:26,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:26,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:26,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:26,447 INFO [StoreOpener-25a1fc9d07cc28733535a08a7e0ef547-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:26,448 DEBUG [StoreOpener-25a1fc9d07cc28733535a08a7e0ef547-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1 2023-02-07 14:03:26,448 DEBUG [StoreOpener-25a1fc9d07cc28733535a08a7e0ef547-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1 2023-02-07 14:03:26,449 INFO [StoreOpener-25a1fc9d07cc28733535a08a7e0ef547-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25a1fc9d07cc28733535a08a7e0ef547 columnFamilyName f1 2023-02-07 14:03:26,449 INFO [StoreOpener-25a1fc9d07cc28733535a08a7e0ef547-1] regionserver.HStore(310): Store=25a1fc9d07cc28733535a08a7e0ef547/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:26,449 INFO [StoreOpener-25a1fc9d07cc28733535a08a7e0ef547-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:26,450 DEBUG [StoreOpener-25a1fc9d07cc28733535a08a7e0ef547-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2 2023-02-07 14:03:26,450 DEBUG [StoreOpener-25a1fc9d07cc28733535a08a7e0ef547-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2 2023-02-07 14:03:26,450 INFO [StoreOpener-25a1fc9d07cc28733535a08a7e0ef547-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25a1fc9d07cc28733535a08a7e0ef547 columnFamilyName f2 2023-02-07 14:03:26,451 INFO [StoreOpener-25a1fc9d07cc28733535a08a7e0ef547-1] regionserver.HStore(310): Store=25a1fc9d07cc28733535a08a7e0ef547/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:26,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:26,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:26,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:26,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:26,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:26,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 25a1fc9d07cc28733535a08a7e0ef547; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63315796, jitterRate=-0.05652111768722534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:26,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 25a1fc9d07cc28733535a08a7e0ef547: Running coprocessor pre-open hook at 1675778606446Writing region info on filesystem at 1675778606446Initializing all the Stores at 1675778606447 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778606447Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778606447Cleaning up temporary data from old regions at 1675778606452 (+5 ms)Cleaning up detritus from prior splits at 1675778606452Running coprocessor post-open hooks at 1675778606456 (+4 ms)Region opened successfully at 1675778606456 2023-02-07 14:03:26,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547., pid=12, masterSystemTime=1675778606442 2023-02-07 14:03:26,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:26,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:26,466 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=25a1fc9d07cc28733535a08a7e0ef547, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,466 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675778606466"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778606466"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778606466"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778606466"}]},"ts":"1675778606466"} 2023-02-07 14:03:26,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-07 14:03:26,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 25a1fc9d07cc28733535a08a7e0ef547, server=jenkins-hbase4.apache.org,40217,1675778604509 in 178 msec 2023-02-07 14:03:26,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-07 14:03:26,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=25a1fc9d07cc28733535a08a7e0ef547, ASSIGN in 334 msec 2023-02-07 14:03:26,471 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:03:26,471 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778606471"}]},"ts":"1675778606471"} 2023-02-07 14:03:26,473 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-07 14:03:26,475 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:03:26,476 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 377 msec 2023-02-07 14:03:26,705 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:26,705 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:26,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:26,706 INFO [Listener at localhost/35907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-07 14:03:26,707 DEBUG [Listener at localhost/35907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-07 14:03:26,707 INFO [Listener at localhost/35907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:03:26,709 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-07 14:03:26,709 INFO [Listener at localhost/35907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:03:26,709 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-07 14:03:26,709 INFO [Listener at localhost/35907] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 14:03:26,745 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40217] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:26,837 INFO [Listener at localhost/35907] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 14:03:26,837 INFO [Listener at localhost/35907] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 14:03:26,837 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:26,837 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:26,838 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-07 14:03:26,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675778606839 (current time:1675778606839). 2023-02-07 14:03:26,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 14:03:26,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] zookeeper.ReadOnlyZKClient(139): Connect 0x7e4218ef to 127.0.0.1:50027 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:26,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5be5a5fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:26,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:26,844 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59936, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:26,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e4218ef to 127.0.0.1:50027 2023-02-07 14:03:26,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:26,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 14:03:26,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-07 14:03:26,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-07 14:03:26,849 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-07 14:03:26,850 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1675779206849 2023-02-07 14:03:26,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-07 14:03:26,850 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:26,851 DEBUG [Listener at localhost/35907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 14:03:26,851 DEBUG [Listener at localhost/35907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 14:03:26,852 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-07 14:03:26,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-07 14:03:26,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-07 14:03:26,854 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-07 14:03:26,854 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1675779206854 2023-02-07 14:03:26,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-07 14:03:26,866 INFO [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-07 14:03:26,866 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:26,867 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-07 14:03:26,867 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-07 14:03:26,868 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,868 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-07 14:03:26,869 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:26,869 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:26,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:26,869 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:26,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:26,869 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-07 14:03:26,869 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:03:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-07 14:03:26,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-07 14:03:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-07 14:03:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-07 14:03:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-07 14:03:26,870 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-07 14:03:26,870 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-07 14:03:26,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-07 14:03:26,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-07 14:03:26,871 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-07 14:03:26,871 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-07 14:03:26,871 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:26,871 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:26,871 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-07 14:03:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-07 14:03:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-07 14:03:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-07 14:03:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40217,1675778604509' joining acquired barrier for procedure (foo) in zk 2023-02-07 14:03:26,872 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35119,1675778604556' joining acquired barrier for procedure (foo) in zk 2023-02-07 14:03:26,876 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:26,876 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,876 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:26,876 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-07 14:03:26,876 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-07 14:03:26,876 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:26,876 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 14:03:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:26,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40217,1675778604509' joining acquired barrier for procedure 'foo' on coordinator 2023-02-07 14:03:26,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@186a5b86[Count = 0] remaining members to acquire global barrier 2023-02-07 14:03:26,878 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-07 14:03:26,878 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:26,879 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 14:03:26,879 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 14:03:26,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:26,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:26,879 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-07 14:03:26,880 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-07 14:03:26,880 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:26,880 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. started... 2023-02-07 14:03:26,880 INFO [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 25a1fc9d07cc28733535a08a7e0ef547 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-07 14:03:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-07 14:03:26,880 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 14:03:26,881 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-07 14:03:26,881 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-07 14:03:26,880 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,881 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:03:26,881 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,35119,1675778604556' in zk 2023-02-07 14:03:26,884 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-07 14:03:26,884 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:26,884 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-07 14:03:26,898 INFO [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/.tmp/f1/3afa655ba42848d9a612ccf5e606715f 2023-02-07 14:03:26,918 INFO [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/.tmp/f2/169db3214bc64cf4a71ffadc3ef2d208 2023-02-07 14:03:26,922 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/.tmp/f1/3afa655ba42848d9a612ccf5e606715f as hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1/3afa655ba42848d9a612ccf5e606715f 2023-02-07 14:03:26,927 INFO [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1/3afa655ba42848d9a612ccf5e606715f, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 14:03:26,927 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/.tmp/f2/169db3214bc64cf4a71ffadc3ef2d208 as hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2/169db3214bc64cf4a71ffadc3ef2d208 2023-02-07 14:03:26,932 INFO [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2/169db3214bc64cf4a71ffadc3ef2d208, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 14:03:26,933 INFO [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 25a1fc9d07cc28733535a08a7e0ef547 in 53ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:26,933 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-07 14:03:26,933 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 25a1fc9d07cc28733535a08a7e0ef547: 2023-02-07 14:03:26,933 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.' region-info for snapshot=foo 2023-02-07 14:03:26,934 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:26,934 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1/3afa655ba42848d9a612ccf5e606715f] hfiles 2023-02-07 14:03:26,934 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1/3afa655ba42848d9a612ccf5e606715f for snapshot=foo 2023-02-07 14:03:26,934 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2/169db3214bc64cf4a71ffadc3ef2d208] hfiles 2023-02-07 14:03:26,934 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2/169db3214bc64cf4a71ffadc3ef2d208 for snapshot=foo 2023-02-07 14:03:26,951 DEBUG [Listener at localhost/35907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:26,951 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:26,952 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:26,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-07 14:03:26,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:03:26,955 DEBUG [Listener at localhost/35907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 14:03:26,960 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. completed. 2023-02-07 14:03:26,960 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:26,960 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-07 14:03:26,960 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-07 14:03:26,960 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,960 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-07 14:03:26,961 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,40217,1675778604509' in zk 2023-02-07 14:03:26,962 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,962 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-07 14:03:26,962 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:26,962 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-07 14:03:26,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:26,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:26,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:26,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 14:03:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:26,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:26,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 14:03:26,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:26,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,40217,1675778604509': 2023-02-07 14:03:26,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40217,1675778604509' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-07 14:03:26,967 INFO [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-07 14:03:26,967 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:03:26,967 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:03:26,967 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-07 14:03:26,967 INFO [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 14:03:26,969 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,969 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:26,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:26,969 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:26,969 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,970 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:26,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:26,970 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 14:03:26,970 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:26,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:26,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 14:03:26,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:26,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:26,972 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-07 14:03:26,973 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:26,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:26,985 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:26,985 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:26,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:26,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:26,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-07 14:03:26,985 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:26,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-07 14:03:26,985 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:26,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:26,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:26,985 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:26,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:26,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.hbase-snapshot/.tmp/foo 2023-02-07 14:03:26,985 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:26,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:26,985 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-07 14:03:26,986 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,986 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-07 14:03:26,986 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:26,986 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 14:03:26,986 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:26,986 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-07 14:03:26,986 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-07 14:03:26,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:26,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:27,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.hbase-snapshot/.tmp/foo to hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.hbase-snapshot/foo 2023-02-07 14:03:27,059 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-07 14:03:27,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.hbase-snapshot/.tmp/foo 2023-02-07 14:03:27,060 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.hbase-snapshot/.tmp/foo 2023-02-07 14:03:27,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1675778606850Consolidate snapshot: foo at 1675778606985 (+135 ms)Loading Region manifests for foo at 1675778606985Writing data manifest for foo at 1675778606988 (+3 ms)Verifying snapshot: foo at 1675778607009 (+21 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1675778607059 (+50 ms) 2023-02-07 14:03:27,062 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-07 14:03:27,063 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 211 msec 2023-02-07 14:03:27,155 DEBUG [Listener at localhost/35907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:27,155 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:27,155 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:27,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-07 14:03:27,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 14:03:27,157 INFO [Listener at localhost/35907] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 14:03:27,157 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:27,157 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:27,161 INFO [Listener at localhost/35907] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 14:03:27,167 INFO [Listener at localhost/35907] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 14:03:27,261 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40217] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:27,378 INFO [Listener at localhost/35907] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 14:03:27,382 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:27,382 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:27,384 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 14:03:27,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,386 INFO [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-07 14:03:27,386 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:27,387 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-07 14:03:27,387 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-07 14:03:27,388 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,388 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,389 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:27,389 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:27,389 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:27,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:27,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:27,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:27,390 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,390 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:03:27,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:03:27,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:03:27,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,390 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,391 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,391 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-07 14:03:27,391 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:27,391 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-07 14:03:27,392 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:27,392 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-07 14:03:27,393 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-07 14:03:27,393 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35119,1675778604556' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-07 14:03:27,393 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-07 14:03:27,393 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 14:03:27,393 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 14:03:27,393 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:27,394 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. started... 2023-02-07 14:03:27,394 INFO [rs(jenkins-hbase4.apache.org,40217,1675778604509)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 25a1fc9d07cc28733535a08a7e0ef547 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-07 14:03:27,396 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,404 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,404 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:27,426 INFO [rs(jenkins-hbase4.apache.org,40217,1675778604509)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/.tmp/f1/d55ca3cae05449b08f3917ea7f01b7b8 2023-02-07 14:03:27,455 INFO [rs(jenkins-hbase4.apache.org,40217,1675778604509)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/.tmp/f2/ad9bb050b4c5478b84adbebc39008b80 2023-02-07 14:03:27,459 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/.tmp/f1/d55ca3cae05449b08f3917ea7f01b7b8 as hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1/d55ca3cae05449b08f3917ea7f01b7b8 2023-02-07 14:03:27,463 INFO [rs(jenkins-hbase4.apache.org,40217,1675778604509)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1/d55ca3cae05449b08f3917ea7f01b7b8, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 14:03:27,464 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/.tmp/f2/ad9bb050b4c5478b84adbebc39008b80 as hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2/ad9bb050b4c5478b84adbebc39008b80 2023-02-07 14:03:27,468 INFO [rs(jenkins-hbase4.apache.org,40217,1675778604509)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2/ad9bb050b4c5478b84adbebc39008b80, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 14:03:27,469 INFO [rs(jenkins-hbase4.apache.org,40217,1675778604509)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 25a1fc9d07cc28733535a08a7e0ef547 in 75ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:27,470 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 25a1fc9d07cc28733535a08a7e0ef547: 2023-02-07 14:03:27,470 DEBUG [rs(jenkins-hbase4.apache.org,40217,1675778604509)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:27,470 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 14:03:27,470 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 14:03:27,470 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,470 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-07 14:03:27,470 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40217,1675778604509' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-07 14:03:27,472 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,472 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:27,472 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,472 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:27,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:27,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:27,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:27,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40217,1675778604509' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-07 14:03:27,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c55cc53[Count = 0] remaining members to acquire global barrier 2023-02-07 14:03:27,474 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-07 14:03:27,474 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,476 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,476 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,476 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-07 14:03:27,476 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-07 14:03:27,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,476 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,35119,1675778604556' in zk 2023-02-07 14:03:27,477 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-07 14:03:27,477 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-07 14:03:27,477 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,477 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:03:27,477 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,40217,1675778604509' in zk 2023-02-07 14:03:27,478 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-07 14:03:27,478 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:27,478 DEBUG [member: 'jenkins-hbase4.apache.org,35119,1675778604556' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-07 14:03:27,479 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-07 14:03:27,479 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,479 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:27,479 DEBUG [member: 'jenkins-hbase4.apache.org,40217,1675778604509' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-07 14:03:27,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:27,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:27,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:27,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:27,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:27,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,40217,1675778604509': 2023-02-07 14:03:27,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40217,1675778604509' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-07 14:03:27,482 INFO [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-07 14:03:27,482 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:03:27,482 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:03:27,482 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,482 INFO [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 14:03:27,484 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,484 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,484 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:27,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:27,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,484 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:27,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,484 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:27,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:27,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:27,485 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,485 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:27,487 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:27,487 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:27,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:27,491 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:27,491 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:27,491 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:27,491 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:27,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:27,491 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,491 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,491 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,491 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:27,491 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,491 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,491 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,491 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,491 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-07 14:03:27,491 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 14:03:27,491 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:27,491 DEBUG [(jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:27,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:27,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:27,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:27,492 DEBUG [Listener at localhost/35907] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-07 14:03:27,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:27,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:27,492 DEBUG [Listener at localhost/35907] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 14:03:27,592 DEBUG [Listener at localhost/35907] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 14:03:27,592 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:27,592 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:27,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 14:03:27,598 INFO [Listener at localhost/35907] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675778606839 type: FLUSH version: 2 ttl: 0 2023-02-07 14:03:27,598 DEBUG [Listener at localhost/35907] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:40709/user/jenkins/test-data/6b53dd89-0db8-c3aa-618f-7cc905481d06/foo/39785f6f-fe45-4027-8809-8ff53c87434f/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,598 INFO [Listener at localhost/35907] snapshot.RestoreSnapshotHelper(239): region to add: 25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:27,598 INFO [Listener at localhost/35907] snapshot.RestoreSnapshotHelper(585): clone region=25a1fc9d07cc28733535a08a7e0ef547 as 25a1fc9d07cc28733535a08a7e0ef547 in snapshot foo 2023-02-07 14:03:27,599 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 25a1fc9d07cc28733535a08a7e0ef547, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40709/user/jenkins/test-data/6b53dd89-0db8-c3aa-618f-7cc905481d06/foo/39785f6f-fe45-4027-8809-8ff53c87434f 2023-02-07 14:03:27,606 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:27,606 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3afa655ba42848d9a612ccf5e606715f from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,608 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 169db3214bc64cf4a71ffadc3ef2d208 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,610 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 25a1fc9d07cc28733535a08a7e0ef547, disabling compactions & flushes 2023-02-07 14:03:27,610 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:27,610 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:27,610 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. after waiting 0 ms 2023-02-07 14:03:27,610 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:27,610 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:27,610 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 25a1fc9d07cc28733535a08a7e0ef547: Waiting for close lock at 1675778607610Disabling compacts and flushes for region at 1675778607610Disabling writes for close at 1675778607610Writing region close event to WAL at 1675778607610Closed at 1675778607610 2023-02-07 14:03:27,612 INFO [Listener at localhost/35907] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1675778606839 type: FLUSH version: 2 ttl: 0 2023-02-07 14:03:27,612 DEBUG [Listener at localhost/35907] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:40709/user/jenkins/test-data/6b53dd89-0db8-c3aa-618f-7cc905481d06/foo/39785f6f-fe45-4027-8809-8ff53c87434f 2023-02-07 14:03:27,612 DEBUG [Listener at localhost/35907] util.CommonFSUtils(682): File system contents for path hdfs://localhost:40709/user/jenkins/test-data/6b53dd89-0db8-c3aa-618f-7cc905481d06/foo/39785f6f-fe45-4027-8809-8ff53c87434f 2023-02-07 14:03:27,613 DEBUG [Listener at localhost/35907] util.CommonFSUtils(699): |-data/ 2023-02-07 14:03:27,617 DEBUG [Listener at localhost/35907] util.CommonFSUtils(699): |----default/ 2023-02-07 14:03:27,617 DEBUG [Listener at localhost/35907] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-07 14:03:27,618 DEBUG [Listener at localhost/35907] util.CommonFSUtils(699): |----------25a1fc9d07cc28733535a08a7e0ef547/ 2023-02-07 14:03:27,618 DEBUG [Listener at localhost/35907] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:27,618 DEBUG [Listener at localhost/35907] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:27,619 DEBUG [Listener at localhost/35907] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=25a1fc9d07cc28733535a08a7e0ef547-3afa655ba42848d9a612ccf5e606715f 2023-02-07 14:03:27,619 DEBUG [Listener at localhost/35907] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:27,619 DEBUG [Listener at localhost/35907] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=25a1fc9d07cc28733535a08a7e0ef547-169db3214bc64cf4a71ffadc3ef2d208 hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1/3afa655ba42848d9a612ccf5e606715f hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1/d55ca3cae05449b08f3917ea7f01b7b8 hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2/169db3214bc64cf4a71ffadc3ef2d208 hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2/ad9bb050b4c5478b84adbebc39008b80 2023-02-07 14:03:27,625 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:27,625 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:27,626 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-07 14:03:27,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-07 14:03:27,629 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:27,629 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:27,629 INFO [Listener at localhost/35907] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,630 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,633 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:27,633 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:27,634 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778607633"}]},"ts":"1675778607633"} 2023-02-07 14:03:27,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 14:03:27,635 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-07 14:03:27,636 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-07 14:03:27,637 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=25a1fc9d07cc28733535a08a7e0ef547, UNASSIGN}] 2023-02-07 14:03:27,638 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=25a1fc9d07cc28733535a08a7e0ef547, UNASSIGN 2023-02-07 14:03:27,639 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=25a1fc9d07cc28733535a08a7e0ef547, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:27,639 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675778607639"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778607639"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778607639"}]},"ts":"1675778607639"} 2023-02-07 14:03:27,640 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 25a1fc9d07cc28733535a08a7e0ef547, server=jenkins-hbase4.apache.org,40217,1675778604509}] 2023-02-07 14:03:27,734 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:27,734 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:27,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 14:03:27,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:27,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 25a1fc9d07cc28733535a08a7e0ef547, disabling compactions & flushes 2023-02-07 14:03:27,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:27,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:27,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. after waiting 0 ms 2023-02-07 14:03:27,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:27,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:27,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547. 2023-02-07 14:03:27,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 25a1fc9d07cc28733535a08a7e0ef547: Waiting for close lock at 1675778607792Running coprocessor pre-close hooks at 1675778607792Disabling compacts and flushes for region at 1675778607792Disabling writes for close at 1675778607793 (+1 ms)Writing region close event to WAL at 1675778607793Running coprocessor post-close hooks at 1675778607797 (+4 ms)Closed at 1675778607797 2023-02-07 14:03:27,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:27,799 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=25a1fc9d07cc28733535a08a7e0ef547, regionState=CLOSED 2023-02-07 14:03:27,799 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1675778607799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778607799"}]},"ts":"1675778607799"} 2023-02-07 14:03:27,801 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-07 14:03:27,801 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 25a1fc9d07cc28733535a08a7e0ef547, server=jenkins-hbase4.apache.org,40217,1675778604509 in 160 msec 2023-02-07 14:03:27,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-07 14:03:27,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=25a1fc9d07cc28733535a08a7e0ef547, UNASSIGN in 164 msec 2023-02-07 14:03:27,803 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778607803"}]},"ts":"1675778607803"} 2023-02-07 14:03:27,804 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-07 14:03:27,805 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-07 14:03:27,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 176 msec 2023-02-07 14:03:27,936 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:27,936 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:27,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 14:03:27,937 INFO [Listener at localhost/35907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-07 14:03:27,937 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:27,938 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:27,938 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,941 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,941 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:27,941 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:27,941 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 14:03:27,944 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:27,946 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1, FileablePath, hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2, FileablePath, hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/recovered.edits] 2023-02-07 14:03:27,949 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1/3afa655ba42848d9a612ccf5e606715f to hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1/3afa655ba42848d9a612ccf5e606715f 2023-02-07 14:03:27,950 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1/d55ca3cae05449b08f3917ea7f01b7b8 to hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f1/d55ca3cae05449b08f3917ea7f01b7b8 2023-02-07 14:03:27,953 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2/169db3214bc64cf4a71ffadc3ef2d208 to hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2/169db3214bc64cf4a71ffadc3ef2d208 2023-02-07 14:03:27,954 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2/ad9bb050b4c5478b84adbebc39008b80 to hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/f2/ad9bb050b4c5478b84adbebc39008b80 2023-02-07 14:03:27,956 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/recovered.edits/12.seqid to hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547/recovered.edits/12.seqid 2023-02-07 14:03:27,957 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/25a1fc9d07cc28733535a08a7e0ef547 2023-02-07 14:03:27,957 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-07 14:03:27,959 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,960 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-07 14:03:27,965 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-07 14:03:27,965 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,966 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-07 14:03:27,966 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778607966"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:27,967 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-07 14:03:27,967 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 25a1fc9d07cc28733535a08a7e0ef547, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1675778606098.25a1fc9d07cc28733535a08a7e0ef547.', STARTKEY => '', ENDKEY => ''}] 2023-02-07 14:03:27,967 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-07 14:03:27,967 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675778607967"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:27,968 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-07 14:03:27,970 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-07 14:03:27,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 32 msec 2023-02-07 14:03:28,042 INFO [Listener at localhost/35907] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:28,042 INFO [Listener at localhost/35907] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:28,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=45073] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 14:03:28,044 INFO [Listener at localhost/35907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-07 14:03:28,044 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 14:03:28,044 INFO [Listener at localhost/35907] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 14:03:28,044 DEBUG [Listener at localhost/35907] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69f4141a to 127.0.0.1:50027 2023-02-07 14:03:28,045 DEBUG [Listener at localhost/35907] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:28,045 DEBUG [Listener at localhost/35907] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 14:03:28,045 DEBUG [Listener at localhost/35907] util.JVMClusterUtil(257): Found active master hash=331062550, stopped=false 2023-02-07 14:03:28,045 INFO [Listener at localhost/35907] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45073,1675778604452 2023-02-07 14:03:28,048 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:28,048 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:28,048 INFO [Listener at localhost/35907] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 14:03:28,048 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:28,048 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:28,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:28,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:28,051 DEBUG [Listener at localhost/35907] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05c6d27e to 127.0.0.1:50027 2023-02-07 14:03:28,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:28,051 DEBUG [Listener at localhost/35907] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:28,051 INFO [Listener at localhost/35907] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40217,1675778604509' ***** 2023-02-07 14:03:28,051 INFO [Listener at localhost/35907] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:03:28,051 INFO [Listener at localhost/35907] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35119,1675778604556' ***** 2023-02-07 14:03:28,051 INFO [Listener at localhost/35907] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:03:28,051 INFO [RS:1;jenkins-hbase4:35119] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:03:28,051 INFO [RS:0;jenkins-hbase4:40217] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:03:28,052 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:03:28,052 INFO [RS:0;jenkins-hbase4:40217] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:03:28,051 INFO [RS:1;jenkins-hbase4:35119] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:03:28,052 INFO [RS:0;jenkins-hbase4:40217] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:03:28,052 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:03:28,052 INFO [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:28,052 INFO [RS:1;jenkins-hbase4:35119] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:03:28,053 INFO [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(3304): Received CLOSE for b50ca9fc180460a6233dec81ca4aaf34 2023-02-07 14:03:28,053 DEBUG [RS:0;jenkins-hbase4:40217] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x418bced7 to 127.0.0.1:50027 2023-02-07 14:03:28,054 DEBUG [RS:0;jenkins-hbase4:40217] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:28,054 INFO [RS:0;jenkins-hbase4:40217] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:03:28,054 INFO [RS:0;jenkins-hbase4:40217] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:03:28,054 INFO [RS:0;jenkins-hbase4:40217] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:03:28,054 INFO [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 14:03:28,054 INFO [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:28,054 DEBUG [RS:1;jenkins-hbase4:35119] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x785b7910 to 127.0.0.1:50027 2023-02-07 14:03:28,054 DEBUG [RS:1;jenkins-hbase4:35119] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:28,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b50ca9fc180460a6233dec81ca4aaf34, disabling compactions & flushes 2023-02-07 14:03:28,054 INFO [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 14:03:28,054 INFO [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 14:03:28,054 DEBUG [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-07 14:03:28,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. 2023-02-07 14:03:28,054 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:03:28,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. 2023-02-07 14:03:28,054 DEBUG [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 14:03:28,054 DEBUG [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(1479): Online Regions={b50ca9fc180460a6233dec81ca4aaf34=hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34.} 2023-02-07 14:03:28,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. after waiting 0 ms 2023-02-07 14:03:28,054 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:03:28,055 DEBUG [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(1505): Waiting on b50ca9fc180460a6233dec81ca4aaf34 2023-02-07 14:03:28,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. 2023-02-07 14:03:28,055 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:03:28,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing b50ca9fc180460a6233dec81ca4aaf34 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 14:03:28,055 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:03:28,055 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:03:28,055 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-07 14:03:28,060 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:28,061 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:28,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/namespace/b50ca9fc180460a6233dec81ca4aaf34/.tmp/info/52796f35e4134eaca82914f045b124dd 2023-02-07 14:03:28,065 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/.tmp/info/c987902724954275a04dcd4bbf7e6b0a 2023-02-07 14:03:28,069 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c987902724954275a04dcd4bbf7e6b0a 2023-02-07 14:03:28,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/namespace/b50ca9fc180460a6233dec81ca4aaf34/.tmp/info/52796f35e4134eaca82914f045b124dd as hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/namespace/b50ca9fc180460a6233dec81ca4aaf34/info/52796f35e4134eaca82914f045b124dd 2023-02-07 14:03:28,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/namespace/b50ca9fc180460a6233dec81ca4aaf34/info/52796f35e4134eaca82914f045b124dd, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 14:03:28,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b50ca9fc180460a6233dec81ca4aaf34 in 19ms, sequenceid=6, compaction requested=false 2023-02-07 14:03:28,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/namespace/b50ca9fc180460a6233dec81ca4aaf34/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 14:03:28,077 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/.tmp/rep_barrier/b6fcef770d5b440cb8b826eb3d0b1a9b 2023-02-07 14:03:28,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. 2023-02-07 14:03:28,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b50ca9fc180460a6233dec81ca4aaf34: Waiting for close lock at 1675778608054Running coprocessor pre-close hooks at 1675778608054Disabling compacts and flushes for region at 1675778608054Disabling writes for close at 1675778608055 (+1 ms)Obtaining lock to block concurrent updates at 1675778608055Preparing flush snapshotting stores in b50ca9fc180460a6233dec81ca4aaf34 at 1675778608055Finished memstore snapshotting hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675778608055Flushing stores of hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. at 1675778608056 (+1 ms)Flushing b50ca9fc180460a6233dec81ca4aaf34/info: creating writer at 1675778608056Flushing b50ca9fc180460a6233dec81ca4aaf34/info: appending metadata at 1675778608058 (+2 ms)Flushing b50ca9fc180460a6233dec81ca4aaf34/info: closing flushed file at 1675778608058Flushing b50ca9fc180460a6233dec81ca4aaf34/info: reopening flushed file at 1675778608070 (+12 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b50ca9fc180460a6233dec81ca4aaf34 in 19ms, sequenceid=6, compaction requested=false at 1675778608074 (+4 ms)Writing region close event to WAL at 1675778608075 (+1 ms)Running coprocessor post-close hooks at 1675778608077 (+2 ms)Closed at 1675778608077 2023-02-07 14:03:28,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675778605532.b50ca9fc180460a6233dec81ca4aaf34. 2023-02-07 14:03:28,080 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6fcef770d5b440cb8b826eb3d0b1a9b 2023-02-07 14:03:28,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/.tmp/table/570f3f0746364c8e806ff7fea758034e 2023-02-07 14:03:28,090 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 570f3f0746364c8e806ff7fea758034e 2023-02-07 14:03:28,091 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/.tmp/info/c987902724954275a04dcd4bbf7e6b0a as hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/info/c987902724954275a04dcd4bbf7e6b0a 2023-02-07 14:03:28,095 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c987902724954275a04dcd4bbf7e6b0a 2023-02-07 14:03:28,095 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/info/c987902724954275a04dcd4bbf7e6b0a, entries=12, sequenceid=21, filesize=6.3 K 2023-02-07 14:03:28,095 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/.tmp/rep_barrier/b6fcef770d5b440cb8b826eb3d0b1a9b as hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/rep_barrier/b6fcef770d5b440cb8b826eb3d0b1a9b 2023-02-07 14:03:28,099 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6fcef770d5b440cb8b826eb3d0b1a9b 2023-02-07 14:03:28,099 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/rep_barrier/b6fcef770d5b440cb8b826eb3d0b1a9b, entries=1, sequenceid=21, filesize=5.1 K 2023-02-07 14:03:28,100 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/.tmp/table/570f3f0746364c8e806ff7fea758034e as hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/table/570f3f0746364c8e806ff7fea758034e 2023-02-07 14:03:28,103 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 570f3f0746364c8e806ff7fea758034e 2023-02-07 14:03:28,103 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/table/570f3f0746364c8e806ff7fea758034e, entries=4, sequenceid=21, filesize=5.1 K 2023-02-07 14:03:28,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false 2023-02-07 14:03:28,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-07 14:03:28,110 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 14:03:28,112 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:28,112 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778608054Running coprocessor pre-close hooks at 1675778608054Disabling compacts and flushes for region at 1675778608054Disabling writes for close at 1675778608055 (+1 ms)Obtaining lock to block concurrent updates at 1675778608055Preparing flush snapshotting stores in 1588230740 at 1675778608055Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1675778608055Flushing stores of hbase:meta,,1.1588230740 at 1675778608056 (+1 ms)Flushing 1588230740/info: creating writer at 1675778608056Flushing 1588230740/info: appending metadata at 1675778608058 (+2 ms)Flushing 1588230740/info: closing flushed file at 1675778608058Flushing 1588230740/rep_barrier: creating writer at 1675778608069 (+11 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675778608072 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675778608072Flushing 1588230740/table: creating writer at 1675778608080 (+8 ms)Flushing 1588230740/table: appending metadata at 1675778608082 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675778608082Flushing 1588230740/info: reopening flushed file at 1675778608091 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675778608096 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675778608100 (+4 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 49ms, sequenceid=21, compaction requested=false at 1675778608104 (+4 ms)Writing region close event to WAL at 1675778608108 (+4 ms)Running coprocessor post-close hooks at 1675778608110 (+2 ms)Closed at 1675778608112 (+2 ms) 2023-02-07 14:03:28,112 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:28,251 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-07 14:03:28,251 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-07 14:03:28,255 INFO [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40217,1675778604509; all regions closed. 2023-02-07 14:03:28,255 INFO [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35119,1675778604556; all regions closed. 2023-02-07 14:03:28,260 DEBUG [RS:0;jenkins-hbase4:40217] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/oldWALs 2023-02-07 14:03:28,260 DEBUG [RS:1;jenkins-hbase4:35119] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/oldWALs 2023-02-07 14:03:28,260 INFO [RS:1;jenkins-hbase4:35119] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35119%2C1675778604556:(num 1675778605884) 2023-02-07 14:03:28,260 DEBUG [RS:1;jenkins-hbase4:35119] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:28,260 INFO [RS:1;jenkins-hbase4:35119] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:28,260 INFO [RS:0;jenkins-hbase4:40217] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40217%2C1675778604509.meta:.meta(num 1675778605476) 2023-02-07 14:03:28,261 INFO [RS:1;jenkins-hbase4:35119] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 14:03:28,261 INFO [RS:1;jenkins-hbase4:35119] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:03:28,261 INFO [RS:1;jenkins-hbase4:35119] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:03:28,261 INFO [RS:1;jenkins-hbase4:35119] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:03:28,261 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:28,262 INFO [RS:1;jenkins-hbase4:35119] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35119 2023-02-07 14:03:28,265 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:28,265 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35119,1675778604556 2023-02-07 14:03:28,265 ERROR [Listener at localhost/35907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7c1cc4cf rejected from java.util.concurrent.ThreadPoolExecutor@78234f94[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:28,265 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:28,265 ERROR [Listener at localhost/35907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@16f631b0 rejected from java.util.concurrent.ThreadPoolExecutor@78234f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:28,265 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:28,265 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:28,268 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35119,1675778604556] 2023-02-07 14:03:28,268 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35119,1675778604556; numProcessing=1 2023-02-07 14:03:28,269 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35119,1675778604556 already deleted, retry=false 2023-02-07 14:03:28,269 DEBUG [RS:0;jenkins-hbase4:40217] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/oldWALs 2023-02-07 14:03:28,270 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35119,1675778604556 expired; onlineServers=1 2023-02-07 14:03:28,270 INFO [RS:0;jenkins-hbase4:40217] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40217%2C1675778604509:(num 1675778606292) 2023-02-07 14:03:28,270 DEBUG [RS:0;jenkins-hbase4:40217] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:28,270 INFO [RS:0;jenkins-hbase4:40217] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:28,270 INFO [RS:0;jenkins-hbase4:40217] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 14:03:28,270 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:28,271 INFO [RS:0;jenkins-hbase4:40217] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40217 2023-02-07 14:03:28,273 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40217,1675778604509 2023-02-07 14:03:28,273 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:28,273 ERROR [Listener at localhost/35907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5496fb4a rejected from java.util.concurrent.ThreadPoolExecutor@50a97500[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:28,274 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40217,1675778604509] 2023-02-07 14:03:28,274 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40217,1675778604509; numProcessing=2 2023-02-07 14:03:28,275 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40217,1675778604509 already deleted, retry=false 2023-02-07 14:03:28,275 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40217,1675778604509 expired; onlineServers=0 2023-02-07 14:03:28,275 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45073,1675778604452' ***** 2023-02-07 14:03:28,275 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 14:03:28,276 DEBUG [M:0;jenkins-hbase4:45073] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17841bb9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:28,276 INFO [M:0;jenkins-hbase4:45073] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45073,1675778604452 2023-02-07 14:03:28,276 INFO [M:0;jenkins-hbase4:45073] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45073,1675778604452; all regions closed. 2023-02-07 14:03:28,276 DEBUG [M:0;jenkins-hbase4:45073] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:28,276 DEBUG [M:0;jenkins-hbase4:45073] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 14:03:28,277 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 14:03:28,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778605121] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778605121,5,FailOnTimeoutGroup] 2023-02-07 14:03:28,277 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778605121] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778605121,5,FailOnTimeoutGroup] 2023-02-07 14:03:28,277 DEBUG [M:0;jenkins-hbase4:45073] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 14:03:28,278 INFO [M:0;jenkins-hbase4:45073] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 14:03:28,278 INFO [M:0;jenkins-hbase4:45073] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 14:03:28,278 INFO [M:0;jenkins-hbase4:45073] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 14:03:28,278 DEBUG [M:0;jenkins-hbase4:45073] master.HMaster(1502): Stopping service threads 2023-02-07 14:03:28,278 INFO [M:0;jenkins-hbase4:45073] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 14:03:28,279 ERROR [M:0;jenkins-hbase4:45073] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 14:03:28,279 INFO [M:0;jenkins-hbase4:45073] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 14:03:28,279 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 14:03:28,279 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:28,279 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:28,280 DEBUG [M:0;jenkins-hbase4:45073] zookeeper.ZKUtil(398): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 14:03:28,280 WARN [M:0;jenkins-hbase4:45073] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 14:03:28,280 INFO [M:0;jenkins-hbase4:45073] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 14:03:28,280 INFO [M:0;jenkins-hbase4:45073] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 14:03:28,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:28,280 DEBUG [M:0;jenkins-hbase4:45073] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:03:28,280 INFO [M:0;jenkins-hbase4:45073] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:28,281 DEBUG [M:0;jenkins-hbase4:45073] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:28,281 DEBUG [M:0;jenkins-hbase4:45073] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:03:28,281 DEBUG [M:0;jenkins-hbase4:45073] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:28,281 INFO [M:0;jenkins-hbase4:45073] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.67 KB heapSize=67.66 KB 2023-02-07 14:03:28,289 INFO [M:0;jenkins-hbase4:45073] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b0c5b55ed7624786bd41279991363f81 2023-02-07 14:03:28,293 DEBUG [M:0;jenkins-hbase4:45073] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b0c5b55ed7624786bd41279991363f81 as hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b0c5b55ed7624786bd41279991363f81 2023-02-07 14:03:28,297 INFO [M:0;jenkins-hbase4:45073] regionserver.HStore(1080): Added hdfs://localhost:40709/user/jenkins/test-data/b31fe4ad-94c2-729f-bd30-8c13af977f16/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b0c5b55ed7624786bd41279991363f81, entries=17, sequenceid=132, filesize=8.7 K 2023-02-07 14:03:28,298 INFO [M:0;jenkins-hbase4:45073] regionserver.HRegion(2947): Finished flush of dataSize ~56.67 KB/58031, heapSize ~67.64 KB/69264, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-07 14:03:28,298 INFO [M:0;jenkins-hbase4:45073] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:28,299 DEBUG [M:0;jenkins-hbase4:45073] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778608280Disabling compacts and flushes for region at 1675778608280Disabling writes for close at 1675778608281 (+1 ms)Obtaining lock to block concurrent updates at 1675778608281Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675778608281Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58031, getHeapSize=69264, getOffHeapSize=0, getCellsCount=145 at 1675778608281Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675778608282 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675778608282Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675778608284 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675778608284Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675778608294 (+10 ms)Finished flush of dataSize ~56.67 KB/58031, heapSize ~67.64 KB/69264, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1675778608298 (+4 ms)Writing region close event to WAL at 1675778608298Closed at 1675778608298 2023-02-07 14:03:28,302 INFO [M:0;jenkins-hbase4:45073] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 14:03:28,302 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:28,302 INFO [M:0;jenkins-hbase4:45073] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45073 2023-02-07 14:03:28,308 DEBUG [M:0;jenkins-hbase4:45073] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45073,1675778604452 already deleted, retry=false 2023-02-07 14:03:28,549 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:28,549 INFO [M:0;jenkins-hbase4:45073] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45073,1675778604452; zookeeper connection closed. 2023-02-07 14:03:28,549 ERROR [Listener at localhost/35907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5f77ac39 rejected from java.util.concurrent.ThreadPoolExecutor@5b48230f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:28,550 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): master:45073-0x1002f1827530000, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:28,550 ERROR [Listener at localhost/35907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4deae604 rejected from java.util.concurrent.ThreadPoolExecutor@5b48230f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:28,649 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:28,649 ERROR [Listener at localhost/35907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@475bcf2a rejected from java.util.concurrent.ThreadPoolExecutor@50a97500[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:28,649 INFO [RS:0;jenkins-hbase4:40217] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40217,1675778604509; zookeeper connection closed. 2023-02-07 14:03:28,649 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:40217-0x1002f1827530001, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:28,649 ERROR [Listener at localhost/35907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3fee40cb rejected from java.util.concurrent.ThreadPoolExecutor@50a97500[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:28,649 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@714d55d9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@714d55d9 2023-02-07 14:03:28,749 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:28,749 INFO [RS:1;jenkins-hbase4:35119] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35119,1675778604556; zookeeper connection closed. 2023-02-07 14:03:28,749 ERROR [Listener at localhost/35907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6e6b14ec rejected from java.util.concurrent.ThreadPoolExecutor@78234f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:28,750 DEBUG [Listener at localhost/35907-EventThread] zookeeper.ZKWatcher(600): regionserver:35119-0x1002f1827530002, quorum=127.0.0.1:50027, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:28,750 ERROR [Listener at localhost/35907-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7ad2e01b rejected from java.util.concurrent.ThreadPoolExecutor@78234f94[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:28,750 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4e72b421] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4e72b421 2023-02-07 14:03:28,750 INFO [Listener at localhost/35907] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 14:03:28,750 WARN [Listener at localhost/35907] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:03:28,754 INFO [Listener at localhost/35907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:28,859 WARN [BP-1494707316-172.31.14.131-1675778603795 heartbeating to localhost/127.0.0.1:40709] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 14:03:28,859 WARN [BP-1494707316-172.31.14.131-1675778603795 heartbeating to localhost/127.0.0.1:40709] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1494707316-172.31.14.131-1675778603795 (Datanode Uuid 33672e60-aa7c-4b61-97d2-580c7cbab655) service to localhost/127.0.0.1:40709 2023-02-07 14:03:28,859 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/cluster_d4ec39a0-82ae-0903-ed26-8de46dcefd7f/dfs/data/data3/current/BP-1494707316-172.31.14.131-1675778603795] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:28,860 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/cluster_d4ec39a0-82ae-0903-ed26-8de46dcefd7f/dfs/data/data4/current/BP-1494707316-172.31.14.131-1675778603795] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:28,861 WARN [Listener at localhost/35907] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:03:28,863 INFO [Listener at localhost/35907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:28,969 WARN [BP-1494707316-172.31.14.131-1675778603795 heartbeating to localhost/127.0.0.1:40709] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 14:03:28,969 WARN [BP-1494707316-172.31.14.131-1675778603795 heartbeating to localhost/127.0.0.1:40709] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1494707316-172.31.14.131-1675778603795 (Datanode Uuid 82a25070-913e-419d-8592-297654b346c8) service to localhost/127.0.0.1:40709 2023-02-07 14:03:28,969 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/cluster_d4ec39a0-82ae-0903-ed26-8de46dcefd7f/dfs/data/data1/current/BP-1494707316-172.31.14.131-1675778603795] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:28,970 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/cluster_d4ec39a0-82ae-0903-ed26-8de46dcefd7f/dfs/data/data2/current/BP-1494707316-172.31.14.131-1675778603795] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:28,979 INFO [Listener at localhost/35907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:29,092 INFO [Listener at localhost/35907] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 14:03:29,108 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 14:03:29,121 INFO [Listener at localhost/35907] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=271 (was 251) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:40709 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:40709 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,45073,1675778604452)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:40709 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:40709 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:40709 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35907 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:40709 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:40709 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=575 (was 655), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=299 (was 273) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=5368 (was 5409) 2023-02-07 14:03:29,132 INFO [Listener at localhost/35907] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=271, OpenFileDescriptor=575, MaxFileDescriptor=60000, SystemLoadAverage=299, ProcessCount=166, AvailableMemoryMB=5367 2023-02-07 14:03:29,143 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/hadoop.log.dir so I do NOT create it in target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95 2023-02-07 14:03:29,143 WARN [Listener at localhost/35907] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/hadoop.log.dir Erasing configuration value by system value. 2023-02-07 14:03:29,143 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/hadoop.tmp.dir so I do NOT create it in target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95 2023-02-07 14:03:29,143 WARN [Listener at localhost/35907] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6598c519-c05d-5a47-2682-f842b52ed4fb/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-07 14:03:29,143 DEBUG [Listener at localhost/35907] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95 2023-02-07 14:03:29,144 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-07 14:03:29,144 INFO [Listener at localhost/35907] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/cluster_3872e920-1de6-efbb-82c1-f9e2c4fdc382, deleteOnExit=true 2023-02-07 14:03:29,144 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 14:03:29,144 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/test.cache.data in system properties and HBase conf 2023-02-07 14:03:29,144 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 14:03:29,144 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/hadoop.log.dir in system properties and HBase conf 2023-02-07 14:03:29,144 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 14:03:29,144 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 14:03:29,144 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 14:03:29,145 DEBUG [Listener at localhost/35907] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 14:03:29,145 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:03:29,145 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 14:03:29,145 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 14:03:29,145 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:03:29,145 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 14:03:29,145 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 14:03:29,145 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 14:03:29,145 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:03:29,145 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 14:03:29,146 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/nfs.dump.dir in system properties and HBase conf 2023-02-07 14:03:29,146 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/java.io.tmpdir in system properties and HBase conf 2023-02-07 14:03:29,146 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 14:03:29,146 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 14:03:29,146 INFO [Listener at localhost/35907] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 14:03:29,150 WARN [Listener at localhost/35907] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:03:29,150 WARN [Listener at localhost/35907] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:03:29,195 WARN [Listener at localhost/35907] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:29,196 INFO [Listener at localhost/35907] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:29,202 INFO [Listener at localhost/35907] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/java.io.tmpdir/Jetty_localhost_45265_hdfs____.v3tpmu/webapp 2023-02-07 14:03:29,298 INFO [Listener at localhost/35907] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45265 2023-02-07 14:03:29,303 WARN [Listener at localhost/35907] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 14:03:29,303 WARN [Listener at localhost/35907] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 14:03:29,340 WARN [Listener at localhost/35931] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:29,359 WARN [Listener at localhost/35931] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:03:29,361 WARN [Listener at localhost/35931] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:29,362 INFO [Listener at localhost/35931] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:29,368 INFO [Listener at localhost/35931] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/java.io.tmpdir/Jetty_localhost_35109_datanode____u0jzz/webapp 2023-02-07 14:03:29,461 INFO [Listener at localhost/35931] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35109 2023-02-07 14:03:29,470 WARN [Listener at localhost/38019] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:29,490 WARN [Listener at localhost/38019] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 14:03:29,494 WARN [Listener at localhost/38019] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 14:03:29,495 INFO [Listener at localhost/38019] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 14:03:29,499 INFO [Listener at localhost/38019] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/java.io.tmpdir/Jetty_localhost_35769_datanode____t89ncv/webapp 2023-02-07 14:03:29,570 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7ce23548f6499f35: Processing first storage report for DS-be9102c6-6f74-47f9-8b3e-aa1e96e44cb7 from datanode 7993f197-25cc-4da0-a297-bf3257aad78c 2023-02-07 14:03:29,570 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7ce23548f6499f35: from storage DS-be9102c6-6f74-47f9-8b3e-aa1e96e44cb7 node DatanodeRegistration(127.0.0.1:41651, datanodeUuid=7993f197-25cc-4da0-a297-bf3257aad78c, infoPort=44341, infoSecurePort=0, ipcPort=38019, storageInfo=lv=-57;cid=testClusterID;nsid=406374958;c=1675778609153), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:29,570 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7ce23548f6499f35: Processing first storage report for DS-16c3ad67-5a3e-4df2-91d7-d71611c8593e from datanode 7993f197-25cc-4da0-a297-bf3257aad78c 2023-02-07 14:03:29,570 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7ce23548f6499f35: from storage DS-16c3ad67-5a3e-4df2-91d7-d71611c8593e node DatanodeRegistration(127.0.0.1:41651, datanodeUuid=7993f197-25cc-4da0-a297-bf3257aad78c, infoPort=44341, infoSecurePort=0, ipcPort=38019, storageInfo=lv=-57;cid=testClusterID;nsid=406374958;c=1675778609153), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:29,605 INFO [Listener at localhost/38019] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35769 2023-02-07 14:03:29,612 WARN [Listener at localhost/33577] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 14:03:29,699 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd544776f03e2a6b: Processing first storage report for DS-c5990960-be05-4055-843e-94e0c21b4a60 from datanode 7aeeff63-2f90-4a35-aa26-5c0ece5559b0 2023-02-07 14:03:29,699 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd544776f03e2a6b: from storage DS-c5990960-be05-4055-843e-94e0c21b4a60 node DatanodeRegistration(127.0.0.1:37983, datanodeUuid=7aeeff63-2f90-4a35-aa26-5c0ece5559b0, infoPort=40183, infoSecurePort=0, ipcPort=33577, storageInfo=lv=-57;cid=testClusterID;nsid=406374958;c=1675778609153), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:29,699 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcd544776f03e2a6b: Processing first storage report for DS-981783f3-04ca-413f-a0c9-13f0f479414c from datanode 7aeeff63-2f90-4a35-aa26-5c0ece5559b0 2023-02-07 14:03:29,699 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcd544776f03e2a6b: from storage DS-981783f3-04ca-413f-a0c9-13f0f479414c node DatanodeRegistration(127.0.0.1:37983, datanodeUuid=7aeeff63-2f90-4a35-aa26-5c0ece5559b0, infoPort=40183, infoSecurePort=0, ipcPort=33577, storageInfo=lv=-57;cid=testClusterID;nsid=406374958;c=1675778609153), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 14:03:29,721 DEBUG [Listener at localhost/33577] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95 2023-02-07 14:03:29,723 INFO [Listener at localhost/33577] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/cluster_3872e920-1de6-efbb-82c1-f9e2c4fdc382/zookeeper_0, clientPort=51996, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/cluster_3872e920-1de6-efbb-82c1-f9e2c4fdc382/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/cluster_3872e920-1de6-efbb-82c1-f9e2c4fdc382/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 14:03:29,724 INFO [Listener at localhost/33577] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51996 2023-02-07 14:03:29,725 INFO [Listener at localhost/33577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:29,725 INFO [Listener at localhost/33577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:29,739 INFO [Listener at localhost/33577] util.FSUtils(479): Created version file at hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432 with version=8 2023-02-07 14:03:29,739 INFO [Listener at localhost/33577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:29,740 INFO [Listener at localhost/33577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:29,741 INFO [Listener at localhost/33577] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35931/user/jenkins/test-data/5150faf3-f18e-1ab5-ac23-638be24ebc37/hbase-staging 2023-02-07 14:03:29,743 INFO [Listener at localhost/33577] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:29,743 INFO [Listener at localhost/33577] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:29,743 INFO [Listener at localhost/33577] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:29,743 INFO [Listener at localhost/33577] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:29,743 INFO [Listener at localhost/33577] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:29,743 INFO [Listener at localhost/33577] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:29,743 INFO [Listener at localhost/33577] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:29,744 INFO [Listener at localhost/33577] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41631 2023-02-07 14:03:29,744 INFO [Listener at localhost/33577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:29,745 INFO [Listener at localhost/33577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:29,745 INFO [Listener at localhost/33577] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41631 connecting to ZooKeeper ensemble=127.0.0.1:51996 2023-02-07 14:03:29,753 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:416310x0, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:29,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41631-0x1002f183c000000 connected 2023-02-07 14:03:29,768 DEBUG [Listener at localhost/33577] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:29,768 DEBUG [Listener at localhost/33577] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:29,769 DEBUG [Listener at localhost/33577] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:29,772 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41631 2023-02-07 14:03:29,772 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41631 2023-02-07 14:03:29,772 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41631 2023-02-07 14:03:29,773 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41631 2023-02-07 14:03:29,776 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41631 2023-02-07 14:03:29,776 INFO [Listener at localhost/33577] master.HMaster(439): hbase.rootdir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432, hbase.cluster.distributed=false 2023-02-07 14:03:29,791 INFO [Listener at localhost/33577] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:29,791 INFO [Listener at localhost/33577] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:29,791 INFO [Listener at localhost/33577] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:29,791 INFO [Listener at localhost/33577] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:29,791 INFO [Listener at localhost/33577] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:29,791 INFO [Listener at localhost/33577] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:29,791 INFO [Listener at localhost/33577] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:29,792 INFO [Listener at localhost/33577] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34393 2023-02-07 14:03:29,792 INFO [Listener at localhost/33577] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:03:29,793 DEBUG [Listener at localhost/33577] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:29,793 INFO [Listener at localhost/33577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:29,794 INFO [Listener at localhost/33577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:29,795 INFO [Listener at localhost/33577] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34393 connecting to ZooKeeper ensemble=127.0.0.1:51996 2023-02-07 14:03:29,797 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:343930x0, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:29,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34393-0x1002f183c000001 connected 2023-02-07 14:03:29,799 DEBUG [Listener at localhost/33577] zookeeper.ZKUtil(164): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:29,800 DEBUG [Listener at localhost/33577] zookeeper.ZKUtil(164): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:29,801 DEBUG [Listener at localhost/33577] zookeeper.ZKUtil(164): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:29,801 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34393 2023-02-07 14:03:29,804 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34393 2023-02-07 14:03:29,804 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34393 2023-02-07 14:03:29,807 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34393 2023-02-07 14:03:29,808 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34393 2023-02-07 14:03:29,818 INFO [Listener at localhost/33577] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-07 14:03:29,818 INFO [Listener at localhost/33577] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:29,819 INFO [Listener at localhost/33577] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:29,819 INFO [Listener at localhost/33577] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 14:03:29,819 INFO [Listener at localhost/33577] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 14:03:29,819 INFO [Listener at localhost/33577] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 14:03:29,819 INFO [Listener at localhost/33577] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 14:03:29,819 INFO [Listener at localhost/33577] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40007 2023-02-07 14:03:29,820 INFO [Listener at localhost/33577] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 14:03:29,822 DEBUG [Listener at localhost/33577] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:29,822 INFO [Listener at localhost/33577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:29,823 INFO [Listener at localhost/33577] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:29,824 INFO [Listener at localhost/33577] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40007 connecting to ZooKeeper ensemble=127.0.0.1:51996 2023-02-07 14:03:29,826 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:400070x0, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 14:03:29,826 DEBUG [Listener at localhost/33577] zookeeper.ZKUtil(164): regionserver:400070x0, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:29,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40007-0x1002f183c000002 connected 2023-02-07 14:03:29,827 DEBUG [Listener at localhost/33577] zookeeper.ZKUtil(164): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:29,828 DEBUG [Listener at localhost/33577] zookeeper.ZKUtil(164): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 14:03:29,832 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40007 2023-02-07 14:03:29,832 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40007 2023-02-07 14:03:29,832 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40007 2023-02-07 14:03:29,833 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40007 2023-02-07 14:03:29,833 DEBUG [Listener at localhost/33577] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40007 2023-02-07 14:03:29,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41631,1675778609742 2023-02-07 14:03:29,839 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:03:29,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41631,1675778609742 2023-02-07 14:03:29,842 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:29,842 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:29,842 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:29,842 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:29,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:03:29,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41631,1675778609742 from backup master directory 2023-02-07 14:03:29,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 14:03:29,847 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41631,1675778609742 2023-02-07 14:03:29,847 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 14:03:29,847 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:29,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,41631,1675778609742 2023-02-07 14:03:29,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/hbase.id with ID: f8f5012d-2e25-4ca7-816d-611d44597de8 2023-02-07 14:03:29,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 14:03:29,868 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:29,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x07c776a8 to 127.0.0.1:51996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:29,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ce9a83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:29,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:29,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 14:03:29,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:29,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/MasterData/data/master/store-tmp 2023-02-07 14:03:29,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:29,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:03:29,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:29,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:29,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:03:29,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:29,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:29,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778609888Disabling compacts and flushes for region at 1675778609888Disabling writes for close at 1675778609889 (+1 ms)Writing region close event to WAL at 1675778609889Closed at 1675778609889 2023-02-07 14:03:29,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/MasterData/WALs/jenkins-hbase4.apache.org,41631,1675778609742 2023-02-07 14:03:29,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41631%2C1675778609742, suffix=, logDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/MasterData/WALs/jenkins-hbase4.apache.org,41631,1675778609742, archiveDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/MasterData/oldWALs, maxLogs=10 2023-02-07 14:03:29,903 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41651,DS-be9102c6-6f74-47f9-8b3e-aa1e96e44cb7,DISK] 2023-02-07 14:03:29,903 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37983,DS-c5990960-be05-4055-843e-94e0c21b4a60,DISK] 2023-02-07 14:03:29,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/MasterData/WALs/jenkins-hbase4.apache.org,41631,1675778609742/jenkins-hbase4.apache.org%2C41631%2C1675778609742.1675778609891 2023-02-07 14:03:29,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41651,DS-be9102c6-6f74-47f9-8b3e-aa1e96e44cb7,DISK], DatanodeInfoWithStorage[127.0.0.1:37983,DS-c5990960-be05-4055-843e-94e0c21b4a60,DISK]] 2023-02-07 14:03:29,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:29,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:29,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:29,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:29,907 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:29,908 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 14:03:29,908 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 14:03:29,909 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:29,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:29,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:29,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 14:03:29,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:29,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61029079, jitterRate=-0.09059585630893707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:03:29,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675778609906Initializing all the Stores at 1675778609907 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778609907Cleaning up temporary data from old regions at 1675778609910 (+3 ms)Cleaning up detritus from prior splits at 1675778609910Region opened successfully at 1675778609913 (+3 ms) 2023-02-07 14:03:29,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 14:03:29,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 14:03:29,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 14:03:29,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 14:03:29,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-07 14:03:29,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-07 14:03:29,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 14:03:29,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 14:03:29,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 14:03:29,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 14:03:29,929 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 14:03:29,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 14:03:29,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 14:03:29,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 14:03:29,931 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:29,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 14:03:29,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 14:03:29,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 14:03:29,934 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:29,934 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:29,934 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:29,934 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:29,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,41631,1675778609742, sessionid=0x1002f183c000000, setting cluster-up flag (Was=false) 2023-02-07 14:03:29,940 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:29,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 14:03:29,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41631,1675778609742 2023-02-07 14:03:29,947 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:29,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 14:03:29,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41631,1675778609742 2023-02-07 14:03:29,952 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.hbase-snapshot/.tmp 2023-02-07 14:03:29,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:29,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:29,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:29,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:29,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-07 14:03:29,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-07 14:03:29,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:29,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:29,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:29,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675778639956 2023-02-07 14:03:29,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 14:03:29,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 14:03:29,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 14:03:29,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 14:03:29,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 14:03:29,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 14:03:29,957 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:29,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:29,957 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 14:03:29,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 14:03:29,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 14:03:29,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 14:03:29,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 14:03:29,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 14:03:29,958 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:29,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778609958,5,FailOnTimeoutGroup] 2023-02-07 14:03:29,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778609958,5,FailOnTimeoutGroup] 2023-02-07 14:03:29,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:29,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 14:03:29,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:29,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:29,971 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:29,972 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:29,972 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432 2023-02-07 14:03:29,978 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:29,978 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:03:29,979 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/info 2023-02-07 14:03:29,980 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:03:29,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:29,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:03:29,981 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:29,982 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:03:29,982 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:29,982 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:03:29,983 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/table 2023-02-07 14:03:29,983 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:03:29,983 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:29,984 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740 2023-02-07 14:03:29,984 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740 2023-02-07 14:03:29,985 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:03:29,986 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:03:29,987 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:29,988 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68485505, jitterRate=0.02051354944705963}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:03:29,988 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675778609978Initializing all the Stores at 1675778609978Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778609978Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778609978Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778609978Cleaning up temporary data from old regions at 1675778609985 (+7 ms)Cleaning up detritus from prior splits at 1675778609985Region opened successfully at 1675778609988 (+3 ms) 2023-02-07 14:03:29,988 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:03:29,988 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:03:29,988 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:03:29,988 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:03:29,988 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:03:29,990 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:29,990 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778609988Disabling compacts and flushes for region at 1675778609988Disabling writes for close at 1675778609988Writing region close event to WAL at 1675778609990 (+2 ms)Closed at 1675778609990 2023-02-07 14:03:29,991 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 14:03:29,991 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 14:03:29,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 14:03:29,992 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 14:03:29,993 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 14:03:30,035 INFO [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(952): ClusterId : f8f5012d-2e25-4ca7-816d-611d44597de8 2023-02-07 14:03:30,035 INFO [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(952): ClusterId : f8f5012d-2e25-4ca7-816d-611d44597de8 2023-02-07 14:03:30,035 DEBUG [RS:1;jenkins-hbase4:40007] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:03:30,035 DEBUG [RS:0;jenkins-hbase4:34393] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 14:03:30,037 DEBUG [RS:1;jenkins-hbase4:40007] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:03:30,037 DEBUG [RS:1;jenkins-hbase4:40007] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:03:30,037 DEBUG [RS:0;jenkins-hbase4:34393] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 14:03:30,037 DEBUG [RS:0;jenkins-hbase4:34393] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 14:03:30,039 DEBUG [RS:1;jenkins-hbase4:40007] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:03:30,040 DEBUG [RS:1;jenkins-hbase4:40007] zookeeper.ReadOnlyZKClient(139): Connect 0x6ee76393 to 127.0.0.1:51996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:30,040 DEBUG [RS:0;jenkins-hbase4:34393] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 14:03:30,041 DEBUG [RS:0;jenkins-hbase4:34393] zookeeper.ReadOnlyZKClient(139): Connect 0x58699197 to 127.0.0.1:51996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:30,045 DEBUG [RS:1;jenkins-hbase4:40007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6020903f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:30,045 DEBUG [RS:1;jenkins-hbase4:40007] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@641f08e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:30,045 DEBUG [RS:0;jenkins-hbase4:34393] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56ae64ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:30,045 DEBUG [RS:0;jenkins-hbase4:34393] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5291fae7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:30,054 DEBUG [RS:0;jenkins-hbase4:34393] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34393 2023-02-07 14:03:30,054 DEBUG [RS:1;jenkins-hbase4:40007] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40007 2023-02-07 14:03:30,054 INFO [RS:0;jenkins-hbase4:34393] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:03:30,054 INFO [RS:1;jenkins-hbase4:40007] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 14:03:30,054 INFO [RS:1;jenkins-hbase4:40007] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:03:30,054 DEBUG [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:03:30,054 INFO [RS:0;jenkins-hbase4:34393] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 14:03:30,054 DEBUG [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 14:03:30,055 INFO [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41631,1675778609742 with isa=jenkins-hbase4.apache.org/172.31.14.131:40007, startcode=1675778609818 2023-02-07 14:03:30,055 INFO [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41631,1675778609742 with isa=jenkins-hbase4.apache.org/172.31.14.131:34393, startcode=1675778609790 2023-02-07 14:03:30,055 DEBUG [RS:1;jenkins-hbase4:40007] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:03:30,055 DEBUG [RS:0;jenkins-hbase4:34393] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 14:03:30,056 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54471, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:03:30,056 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51037, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 14:03:30,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41631] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:30,058 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:30,059 DEBUG [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432 2023-02-07 14:03:30,059 DEBUG [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35931 2023-02-07 14:03:30,059 DEBUG [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432 2023-02-07 14:03:30,059 DEBUG [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:03:30,059 DEBUG [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35931 2023-02-07 14:03:30,059 DEBUG [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 14:03:30,063 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:30,063 DEBUG [RS:1;jenkins-hbase4:40007] zookeeper.ZKUtil(162): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:30,063 DEBUG [RS:0;jenkins-hbase4:34393] zookeeper.ZKUtil(162): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:30,064 WARN [RS:1;jenkins-hbase4:40007] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:30,064 WARN [RS:0;jenkins-hbase4:34393] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 14:03:30,064 INFO [RS:1;jenkins-hbase4:40007] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:30,064 INFO [RS:0;jenkins-hbase4:34393] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:30,064 DEBUG [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/WALs/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:30,064 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40007,1675778609818] 2023-02-07 14:03:30,064 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34393,1675778609790] 2023-02-07 14:03:30,064 DEBUG [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/WALs/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:30,069 DEBUG [RS:1;jenkins-hbase4:40007] zookeeper.ZKUtil(162): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:30,069 DEBUG [RS:0;jenkins-hbase4:34393] zookeeper.ZKUtil(162): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:30,070 DEBUG [RS:1;jenkins-hbase4:40007] zookeeper.ZKUtil(162): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:30,070 DEBUG [RS:0;jenkins-hbase4:34393] zookeeper.ZKUtil(162): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:30,070 DEBUG [RS:1;jenkins-hbase4:40007] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:03:30,070 INFO [RS:1;jenkins-hbase4:40007] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:03:30,071 DEBUG [RS:0;jenkins-hbase4:34393] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 14:03:30,071 INFO [RS:0;jenkins-hbase4:34393] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 14:03:30,071 INFO [RS:1;jenkins-hbase4:40007] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:03:30,072 INFO [RS:1;jenkins-hbase4:40007] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:03:30,072 INFO [RS:1;jenkins-hbase4:40007] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,072 INFO [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:03:30,075 INFO [RS:0;jenkins-hbase4:34393] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 14:03:30,076 INFO [RS:0;jenkins-hbase4:34393] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 14:03:30,076 INFO [RS:1;jenkins-hbase4:40007] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,076 INFO [RS:0;jenkins-hbase4:34393] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,076 DEBUG [RS:1;jenkins-hbase4:40007] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,076 DEBUG [RS:1;jenkins-hbase4:40007] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,076 DEBUG [RS:1;jenkins-hbase4:40007] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,076 DEBUG [RS:1;jenkins-hbase4:40007] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,076 DEBUG [RS:1;jenkins-hbase4:40007] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,076 DEBUG [RS:1;jenkins-hbase4:40007] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:30,077 DEBUG [RS:1;jenkins-hbase4:40007] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,077 DEBUG [RS:1;jenkins-hbase4:40007] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,077 DEBUG [RS:1;jenkins-hbase4:40007] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,077 DEBUG [RS:1;jenkins-hbase4:40007] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,080 INFO [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 14:03:30,084 INFO [RS:1;jenkins-hbase4:40007] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,084 INFO [RS:1;jenkins-hbase4:40007] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,084 INFO [RS:1;jenkins-hbase4:40007] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,084 INFO [RS:0;jenkins-hbase4:34393] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,085 DEBUG [RS:0;jenkins-hbase4:34393] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,085 DEBUG [RS:0;jenkins-hbase4:34393] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,085 DEBUG [RS:0;jenkins-hbase4:34393] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,085 DEBUG [RS:0;jenkins-hbase4:34393] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,085 DEBUG [RS:0;jenkins-hbase4:34393] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,085 DEBUG [RS:0;jenkins-hbase4:34393] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-07 14:03:30,086 DEBUG [RS:0;jenkins-hbase4:34393] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,086 DEBUG [RS:0;jenkins-hbase4:34393] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,086 DEBUG [RS:0;jenkins-hbase4:34393] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,086 DEBUG [RS:0;jenkins-hbase4:34393] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-07 14:03:30,087 INFO [RS:0;jenkins-hbase4:34393] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,087 INFO [RS:0;jenkins-hbase4:34393] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,087 INFO [RS:0;jenkins-hbase4:34393] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,097 INFO [RS:1;jenkins-hbase4:40007] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:03:30,097 INFO [RS:1;jenkins-hbase4:40007] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40007,1675778609818-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,104 INFO [RS:0;jenkins-hbase4:34393] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 14:03:30,104 INFO [RS:0;jenkins-hbase4:34393] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34393,1675778609790-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,108 INFO [RS:1;jenkins-hbase4:40007] regionserver.Replication(203): jenkins-hbase4.apache.org,40007,1675778609818 started 2023-02-07 14:03:30,108 INFO [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40007,1675778609818, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40007, sessionid=0x1002f183c000002 2023-02-07 14:03:30,108 DEBUG [RS:1;jenkins-hbase4:40007] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:03:30,108 DEBUG [RS:1;jenkins-hbase4:40007] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:30,108 DEBUG [RS:1;jenkins-hbase4:40007] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40007,1675778609818' 2023-02-07 14:03:30,108 DEBUG [RS:1;jenkins-hbase4:40007] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:30,108 DEBUG [RS:1;jenkins-hbase4:40007] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:30,108 DEBUG [RS:1;jenkins-hbase4:40007] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:03:30,109 DEBUG [RS:1;jenkins-hbase4:40007] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:03:30,109 DEBUG [RS:1;jenkins-hbase4:40007] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:30,109 DEBUG [RS:1;jenkins-hbase4:40007] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40007,1675778609818' 2023-02-07 14:03:30,109 DEBUG [RS:1;jenkins-hbase4:40007] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:30,109 DEBUG [RS:1;jenkins-hbase4:40007] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:30,109 DEBUG [RS:1;jenkins-hbase4:40007] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:03:30,109 INFO [RS:1;jenkins-hbase4:40007] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:03:30,109 INFO [RS:1;jenkins-hbase4:40007] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:03:30,120 INFO [RS:0;jenkins-hbase4:34393] regionserver.Replication(203): jenkins-hbase4.apache.org,34393,1675778609790 started 2023-02-07 14:03:30,120 INFO [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34393,1675778609790, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34393, sessionid=0x1002f183c000001 2023-02-07 14:03:30,120 DEBUG [RS:0;jenkins-hbase4:34393] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 14:03:30,120 DEBUG [RS:0;jenkins-hbase4:34393] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:30,120 DEBUG [RS:0;jenkins-hbase4:34393] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34393,1675778609790' 2023-02-07 14:03:30,120 DEBUG [RS:0;jenkins-hbase4:34393] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:30,120 DEBUG [RS:0;jenkins-hbase4:34393] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:30,120 DEBUG [RS:0;jenkins-hbase4:34393] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 14:03:30,120 DEBUG [RS:0;jenkins-hbase4:34393] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 14:03:30,120 DEBUG [RS:0;jenkins-hbase4:34393] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:30,120 DEBUG [RS:0;jenkins-hbase4:34393] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34393,1675778609790' 2023-02-07 14:03:30,121 DEBUG [RS:0;jenkins-hbase4:34393] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:30,121 DEBUG [RS:0;jenkins-hbase4:34393] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:30,121 DEBUG [RS:0;jenkins-hbase4:34393] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 14:03:30,121 INFO [RS:0;jenkins-hbase4:34393] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 14:03:30,121 INFO [RS:0;jenkins-hbase4:34393] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 14:03:30,144 DEBUG [jenkins-hbase4:41631] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-07 14:03:30,144 DEBUG [jenkins-hbase4:41631] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:30,145 DEBUG [jenkins-hbase4:41631] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:30,145 DEBUG [jenkins-hbase4:41631] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:30,145 DEBUG [jenkins-hbase4:41631] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:30,146 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34393,1675778609790, state=OPENING 2023-02-07 14:03:30,148 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 14:03:30,149 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:30,149 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34393,1675778609790}] 2023-02-07 14:03:30,149 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:03:30,304 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:30,304 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 14:03:30,306 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51858, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 14:03:30,309 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 14:03:30,309 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 14:03:30,310 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34393%2C1675778609790.meta, suffix=.meta, logDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/WALs/jenkins-hbase4.apache.org,34393,1675778609790, archiveDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/oldWALs, maxLogs=32 2023-02-07 14:03:30,325 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41651,DS-be9102c6-6f74-47f9-8b3e-aa1e96e44cb7,DISK] 2023-02-07 14:03:30,325 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37983,DS-c5990960-be05-4055-843e-94e0c21b4a60,DISK] 2023-02-07 14:03:30,327 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/WALs/jenkins-hbase4.apache.org,34393,1675778609790/jenkins-hbase4.apache.org%2C34393%2C1675778609790.meta.1675778610311.meta 2023-02-07 14:03:30,328 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37983,DS-c5990960-be05-4055-843e-94e0c21b4a60,DISK], DatanodeInfoWithStorage[127.0.0.1:41651,DS-be9102c6-6f74-47f9-8b3e-aa1e96e44cb7,DISK]] 2023-02-07 14:03:30,328 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:30,328 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 14:03:30,328 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 14:03:30,328 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 14:03:30,328 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 14:03:30,328 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:30,329 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 14:03:30,329 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 14:03:30,330 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 14:03:30,330 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/info 2023-02-07 14:03:30,330 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/info 2023-02-07 14:03:30,331 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 14:03:30,331 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:30,331 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 14:03:30,332 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:30,332 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/rep_barrier 2023-02-07 14:03:30,332 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 14:03:30,333 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:30,333 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 14:03:30,333 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/table 2023-02-07 14:03:30,333 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/table 2023-02-07 14:03:30,334 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 14:03:30,334 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:30,335 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740 2023-02-07 14:03:30,335 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740 2023-02-07 14:03:30,337 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 14:03:30,338 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 14:03:30,338 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63856693, jitterRate=-0.048461124300956726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 14:03:30,339 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675778610329Writing region info on filesystem at 1675778610329Initializing all the Stores at 1675778610329Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778610329Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778610329Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778610329Cleaning up temporary data from old regions at 1675778610336 (+7 ms)Cleaning up detritus from prior splits at 1675778610336Running coprocessor post-open hooks at 1675778610339 (+3 ms)Region opened successfully at 1675778610339 2023-02-07 14:03:30,339 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675778610304 2023-02-07 14:03:30,342 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 14:03:30,343 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 14:03:30,343 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34393,1675778609790, state=OPEN 2023-02-07 14:03:30,344 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 14:03:30,345 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 14:03:30,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 14:03:30,346 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34393,1675778609790 in 196 msec 2023-02-07 14:03:30,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 14:03:30,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 355 msec 2023-02-07 14:03:30,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 394 msec 2023-02-07 14:03:30,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675778609839, completionTime=-1 2023-02-07 14:03:30,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-07 14:03:30,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 14:03:30,351 DEBUG [hconnection-0x1476d0c3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:30,352 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51860, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:30,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-07 14:03:30,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675778670353 2023-02-07 14:03:30,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675778730353 2023-02-07 14:03:30,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-07 14:03:30,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41631,1675778609742-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41631,1675778609742-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41631,1675778609742-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41631, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 14:03:30,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 14:03:30,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:30,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 14:03:30,360 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 14:03:30,361 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:03:30,362 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:03:30,363 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/hbase/namespace/f57b37e13d0960b889de7298b4cc2485 2023-02-07 14:03:30,364 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/hbase/namespace/f57b37e13d0960b889de7298b4cc2485 empty. 2023-02-07 14:03:30,364 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/hbase/namespace/f57b37e13d0960b889de7298b4cc2485 2023-02-07 14:03:30,364 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 14:03:30,373 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:30,374 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => f57b37e13d0960b889de7298b4cc2485, NAME => 'hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp 2023-02-07 14:03:30,382 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:30,382 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing f57b37e13d0960b889de7298b4cc2485, disabling compactions & flushes 2023-02-07 14:03:30,382 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. 2023-02-07 14:03:30,382 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. 2023-02-07 14:03:30,382 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. after waiting 0 ms 2023-02-07 14:03:30,382 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. 2023-02-07 14:03:30,382 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. 2023-02-07 14:03:30,382 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for f57b37e13d0960b889de7298b4cc2485: Waiting for close lock at 1675778610382Disabling compacts and flushes for region at 1675778610382Disabling writes for close at 1675778610382Writing region close event to WAL at 1675778610382Closed at 1675778610382 2023-02-07 14:03:30,384 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:03:30,385 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778610384"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778610384"}]},"ts":"1675778610384"} 2023-02-07 14:03:30,386 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 14:03:30,387 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:03:30,387 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778610387"}]},"ts":"1675778610387"} 2023-02-07 14:03:30,388 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 14:03:30,390 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:30,391 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:30,391 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:30,391 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:30,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f57b37e13d0960b889de7298b4cc2485, ASSIGN}] 2023-02-07 14:03:30,394 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f57b37e13d0960b889de7298b4cc2485, ASSIGN 2023-02-07 14:03:30,394 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f57b37e13d0960b889de7298b4cc2485, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40007,1675778609818; forceNewPlan=false, retain=false 2023-02-07 14:03:30,545 INFO [jenkins-hbase4:41631] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 14:03:30,545 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f57b37e13d0960b889de7298b4cc2485, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:30,545 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778610545"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778610545"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778610545"}]},"ts":"1675778610545"} 2023-02-07 14:03:30,547 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f57b37e13d0960b889de7298b4cc2485, server=jenkins-hbase4.apache.org,40007,1675778609818}] 2023-02-07 14:03:30,700 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:30,700 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 14:03:30,701 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47584, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 14:03:30,705 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. 2023-02-07 14:03:30,706 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40007%2C1675778609818, suffix=, logDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/WALs/jenkins-hbase4.apache.org,40007,1675778609818, archiveDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/oldWALs, maxLogs=32 2023-02-07 14:03:30,720 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37983,DS-c5990960-be05-4055-843e-94e0c21b4a60,DISK] 2023-02-07 14:03:30,720 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41651,DS-be9102c6-6f74-47f9-8b3e-aa1e96e44cb7,DISK] 2023-02-07 14:03:30,721 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/WALs/jenkins-hbase4.apache.org,40007,1675778609818/jenkins-hbase4.apache.org%2C40007%2C1675778609818.1675778610706 2023-02-07 14:03:30,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37983,DS-c5990960-be05-4055-843e-94e0c21b4a60,DISK], DatanodeInfoWithStorage[127.0.0.1:41651,DS-be9102c6-6f74-47f9-8b3e-aa1e96e44cb7,DISK]] 2023-02-07 14:03:30,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f57b37e13d0960b889de7298b4cc2485, NAME => 'hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:30,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f57b37e13d0960b889de7298b4cc2485 2023-02-07 14:03:30,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:30,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f57b37e13d0960b889de7298b4cc2485 2023-02-07 14:03:30,722 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f57b37e13d0960b889de7298b4cc2485 2023-02-07 14:03:30,723 INFO [StoreOpener-f57b37e13d0960b889de7298b4cc2485-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f57b37e13d0960b889de7298b4cc2485 2023-02-07 14:03:30,724 DEBUG [StoreOpener-f57b37e13d0960b889de7298b4cc2485-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/namespace/f57b37e13d0960b889de7298b4cc2485/info 2023-02-07 14:03:30,724 DEBUG [StoreOpener-f57b37e13d0960b889de7298b4cc2485-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/namespace/f57b37e13d0960b889de7298b4cc2485/info 2023-02-07 14:03:30,724 INFO [StoreOpener-f57b37e13d0960b889de7298b4cc2485-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f57b37e13d0960b889de7298b4cc2485 columnFamilyName info 2023-02-07 14:03:30,725 INFO [StoreOpener-f57b37e13d0960b889de7298b4cc2485-1] regionserver.HStore(310): Store=f57b37e13d0960b889de7298b4cc2485/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:30,725 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/namespace/f57b37e13d0960b889de7298b4cc2485 2023-02-07 14:03:30,725 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/namespace/f57b37e13d0960b889de7298b4cc2485 2023-02-07 14:03:30,727 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f57b37e13d0960b889de7298b4cc2485 2023-02-07 14:03:30,729 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/namespace/f57b37e13d0960b889de7298b4cc2485/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:30,729 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f57b37e13d0960b889de7298b4cc2485; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69112206, jitterRate=0.02985212206840515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 14:03:30,729 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f57b37e13d0960b889de7298b4cc2485: Running coprocessor pre-open hook at 1675778610722Writing region info on filesystem at 1675778610722Initializing all the Stores at 1675778610723 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675778610723Cleaning up temporary data from old regions at 1675778610726 (+3 ms)Cleaning up detritus from prior splits at 1675778610726Running coprocessor post-open hooks at 1675778610729 (+3 ms)Region opened successfully at 1675778610729 2023-02-07 14:03:30,730 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485., pid=6, masterSystemTime=1675778610700 2023-02-07 14:03:30,733 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. 2023-02-07 14:03:30,736 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. 2023-02-07 14:03:30,736 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f57b37e13d0960b889de7298b4cc2485, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:30,736 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675778610736"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778610736"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778610736"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778610736"}]},"ts":"1675778610736"} 2023-02-07 14:03:30,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 14:03:30,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f57b37e13d0960b889de7298b4cc2485, server=jenkins-hbase4.apache.org,40007,1675778609818 in 190 msec 2023-02-07 14:03:30,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 14:03:30,740 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f57b37e13d0960b889de7298b4cc2485, ASSIGN in 348 msec 2023-02-07 14:03:30,741 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:03:30,741 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778610741"}]},"ts":"1675778610741"} 2023-02-07 14:03:30,742 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 14:03:30,743 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:03:30,745 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 385 msec 2023-02-07 14:03:30,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 14:03:30,763 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:30,763 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:30,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:30,765 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47598, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:30,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 14:03:30,773 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:30,775 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-07 14:03:30,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 14:03:30,783 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 14:03:30,786 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-07 14:03:30,792 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 14:03:30,795 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 14:03:30,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.948sec 2023-02-07 14:03:30,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 14:03:30,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 14:03:30,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 14:03:30,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41631,1675778609742-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 14:03:30,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41631,1675778609742-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 14:03:30,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 14:03:30,836 DEBUG [Listener at localhost/33577] zookeeper.ReadOnlyZKClient(139): Connect 0x06fefa53 to 127.0.0.1:51996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:30,839 DEBUG [Listener at localhost/33577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dd1af59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:30,841 DEBUG [hconnection-0x7cf4d6d5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:30,843 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51874, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:30,844 INFO [Listener at localhost/33577] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41631,1675778609742 2023-02-07 14:03:30,844 DEBUG [Listener at localhost/33577] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-07 14:03:30,844 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:30,844 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:30,847 DEBUG [Listener at localhost/33577] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 14:03:30,848 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54778, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 14:03:30,849 INFO [Listener at localhost/33577] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 14:03:30,849 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-07 14:03:30,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-07 14:03:30,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 78 connection: 172.31.14.131:54778 deadline: 1675778670849, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-07 14:03:30,850 INFO [Listener at localhost/33577] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-07 14:03:30,850 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:30,850 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:30,852 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 14:03:30,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-07 14:03:30,854 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 14:03:30,854 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-07 14:03:30,854 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:30,855 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:30,855 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 14:03:30,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:30,856 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:30,857 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394 empty. 2023-02-07 14:03:30,857 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:30,857 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 14:03:30,865 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-07 14:03:30,866 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => bcca6b76fa34a92f0b84c5644a0c6394, NAME => 'testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp 2023-02-07 14:03:30,871 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:30,872 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing bcca6b76fa34a92f0b84c5644a0c6394, disabling compactions & flushes 2023-02-07 14:03:30,872 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:30,872 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:30,872 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. after waiting 0 ms 2023-02-07 14:03:30,872 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:30,872 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:30,872 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for bcca6b76fa34a92f0b84c5644a0c6394: Waiting for close lock at 1675778610872Disabling compacts and flushes for region at 1675778610872Disabling writes for close at 1675778610872Writing region close event to WAL at 1675778610872Closed at 1675778610872 2023-02-07 14:03:30,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 14:03:30,874 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675778610874"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778610874"}]},"ts":"1675778610874"} 2023-02-07 14:03:30,875 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 14:03:30,876 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 14:03:30,876 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778610876"}]},"ts":"1675778610876"} 2023-02-07 14:03:30,877 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-07 14:03:30,880 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-07 14:03:30,881 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-07 14:03:30,881 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-07 14:03:30,881 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-07 14:03:30,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bcca6b76fa34a92f0b84c5644a0c6394, ASSIGN}] 2023-02-07 14:03:30,885 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bcca6b76fa34a92f0b84c5644a0c6394, ASSIGN 2023-02-07 14:03:30,886 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bcca6b76fa34a92f0b84c5644a0c6394, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34393,1675778609790; forceNewPlan=false, retain=false 2023-02-07 14:03:30,955 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:30,956 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:30,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:30,997 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-07 14:03:31,037 INFO [jenkins-hbase4:41631] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-07 14:03:31,037 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bcca6b76fa34a92f0b84c5644a0c6394, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,037 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675778611037"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778611037"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778611037"}]},"ts":"1675778611037"} 2023-02-07 14:03:31,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure bcca6b76fa34a92f0b84c5644a0c6394, server=jenkins-hbase4.apache.org,34393,1675778609790}] 2023-02-07 14:03:31,123 INFO [RS:0;jenkins-hbase4:34393] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34393%2C1675778609790, suffix=, logDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/WALs/jenkins-hbase4.apache.org,34393,1675778609790, archiveDir=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/oldWALs, maxLogs=32 2023-02-07 14:03:31,142 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41651,DS-be9102c6-6f74-47f9-8b3e-aa1e96e44cb7,DISK] 2023-02-07 14:03:31,142 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37983,DS-c5990960-be05-4055-843e-94e0c21b4a60,DISK] 2023-02-07 14:03:31,144 INFO [RS:0;jenkins-hbase4:34393] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/WALs/jenkins-hbase4.apache.org,34393,1675778609790/jenkins-hbase4.apache.org%2C34393%2C1675778609790.1675778611123 2023-02-07 14:03:31,144 DEBUG [RS:0;jenkins-hbase4:34393] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41651,DS-be9102c6-6f74-47f9-8b3e-aa1e96e44cb7,DISK], DatanodeInfoWithStorage[127.0.0.1:37983,DS-c5990960-be05-4055-843e-94e0c21b4a60,DISK]] 2023-02-07 14:03:31,157 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:31,157 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:31,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:31,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:31,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bcca6b76fa34a92f0b84c5644a0c6394, NAME => 'testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.', STARTKEY => '', ENDKEY => ''} 2023-02-07 14:03:31,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:31,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:31,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:31,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:31,195 INFO [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:31,196 DEBUG [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1 2023-02-07 14:03:31,196 DEBUG [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1 2023-02-07 14:03:31,197 INFO [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcca6b76fa34a92f0b84c5644a0c6394 columnFamilyName f1 2023-02-07 14:03:31,197 INFO [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] regionserver.HStore(310): Store=bcca6b76fa34a92f0b84c5644a0c6394/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:31,197 INFO [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:31,198 DEBUG [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2 2023-02-07 14:03:31,198 DEBUG [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2 2023-02-07 14:03:31,198 INFO [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcca6b76fa34a92f0b84c5644a0c6394 columnFamilyName f2 2023-02-07 14:03:31,199 INFO [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] regionserver.HStore(310): Store=bcca6b76fa34a92f0b84c5644a0c6394/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:31,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:31,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:31,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:31,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:31,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 14:03:31,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bcca6b76fa34a92f0b84c5644a0c6394; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69803622, jitterRate=0.04015502333641052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:31,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bcca6b76fa34a92f0b84c5644a0c6394: Running coprocessor pre-open hook at 1675778611194Writing region info on filesystem at 1675778611194Initializing all the Stores at 1675778611195 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778611195Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778611195Cleaning up temporary data from old regions at 1675778611200 (+5 ms)Cleaning up detritus from prior splits at 1675778611200Running coprocessor post-open hooks at 1675778611203 (+3 ms)Region opened successfully at 1675778611203 2023-02-07 14:03:31,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394., pid=12, masterSystemTime=1675778611190 2023-02-07 14:03:31,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:31,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:31,206 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bcca6b76fa34a92f0b84c5644a0c6394, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,206 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675778611206"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675778611206"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675778611206"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675778611206"}]},"ts":"1675778611206"} 2023-02-07 14:03:31,208 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-07 14:03:31,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure bcca6b76fa34a92f0b84c5644a0c6394, server=jenkins-hbase4.apache.org,34393,1675778609790 in 168 msec 2023-02-07 14:03:31,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-07 14:03:31,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bcca6b76fa34a92f0b84c5644a0c6394, ASSIGN in 328 msec 2023-02-07 14:03:31,210 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 14:03:31,211 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778611210"}]},"ts":"1675778611210"} 2023-02-07 14:03:31,212 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-07 14:03:31,214 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 14:03:31,215 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 362 msec 2023-02-07 14:03:31,459 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:31,459 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:31,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-07 14:03:31,461 INFO [Listener at localhost/33577] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-07 14:03:31,461 DEBUG [Listener at localhost/33577] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-07 14:03:31,462 INFO [Listener at localhost/33577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:03:31,464 INFO [Listener at localhost/33577] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-07 14:03:31,464 INFO [Listener at localhost/33577] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 14:03:31,464 INFO [Listener at localhost/33577] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-07 14:03:31,464 INFO [Listener at localhost/33577] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-07 14:03:31,503 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34393] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:31,585 INFO [Listener at localhost/33577] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-07 14:03:31,585 INFO [Listener at localhost/33577] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-07 14:03:31,586 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:31,586 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:31,587 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 14:03:31,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675778611587 (current time:1675778611587). 2023-02-07 14:03:31,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 14:03:31,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] zookeeper.ReadOnlyZKClient(139): Connect 0x5411eeef to 127.0.0.1:51996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 14:03:31,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16ece328, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 14:03:31,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 14:03:31,592 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51888, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 14:03:31,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5411eeef to 127.0.0.1:51996 2023-02-07 14:03:31,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:31,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 14:03:31,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 14:03:31,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 14:03:31,597 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 14:03:31,598 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1675779211598 2023-02-07 14:03:31,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-07 14:03:31,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-07 14:03:31,607 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-07 14:03:31,607 DEBUG [Listener at localhost/33577] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-07 14:03:31,607 DEBUG [Listener at localhost/33577] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 14:03:31,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 14:03:31,608 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 12 msec 2023-02-07 14:03:31,609 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 14:03:31,609 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1675779211609 2023-02-07 14:03:31,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-07 14:03:31,624 INFO [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-07 14:03:31,625 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:31,626 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-07 14:03:31,626 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-07 14:03:31,626 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,626 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 14:03:31,628 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:31,628 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:31,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:31,628 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:31,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:31,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:31,629 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,629 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:03:31,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 14:03:31,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 14:03:31,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-07 14:03:31,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 14:03:31,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-07 14:03:31,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 14:03:31,630 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-07 14:03:31,630 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-07 14:03:31,630 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-07 14:03:31,630 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-07 14:03:31,630 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:31,632 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 14:03:31,632 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-07 14:03:31,632 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-07 14:03:31,632 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40007,1675778609818' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-07 14:03:31,632 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-07 14:03:31,632 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 14:03:31,634 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-07 14:03:31,634 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-07 14:03:31,634 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34393,1675778609790' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-07 14:03:31,635 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 14:03:31,636 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 14:03:31,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 14:03:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:31,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 14:03:31,636 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:31,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:31,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:31,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 14:03:31,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:31,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:31,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34393,1675778609790' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-07 14:03:31,638 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-07 14:03:31,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cd0f386[Count = 0] remaining members to acquire global barrier 2023-02-07 14:03:31,638 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 14:03:31,639 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 14:03:31,639 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 14:03:31,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 14:03:31,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 14:03:31,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 14:03:31,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 14:03:31,640 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,640 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:03:31,640 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 14:03:31,640 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-07 14:03:31,640 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-07 14:03:31,640 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40007,1675778609818' in zk 2023-02-07 14:03:31,640 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-07 14:03:31,640 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 14:03:31,640 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:31,640 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. started... 2023-02-07 14:03:31,640 INFO [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bcca6b76fa34a92f0b84c5644a0c6394 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-07 14:03:31,642 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-07 14:03:31,642 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:31,642 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-07 14:03:31,658 INFO [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/.tmp/f1/85cc82af41da44c7bfe4505715db6890 2023-02-07 14:03:31,683 INFO [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/.tmp/f2/2ae26a7bfe524294bb233d719da9ab00 2023-02-07 14:03:31,688 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/.tmp/f1/85cc82af41da44c7bfe4505715db6890 as hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1/85cc82af41da44c7bfe4505715db6890 2023-02-07 14:03:31,692 INFO [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1/85cc82af41da44c7bfe4505715db6890, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 14:03:31,693 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/.tmp/f2/2ae26a7bfe524294bb233d719da9ab00 as hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2/2ae26a7bfe524294bb233d719da9ab00 2023-02-07 14:03:31,697 INFO [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2/2ae26a7bfe524294bb233d719da9ab00, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-07 14:03:31,698 INFO [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for bcca6b76fa34a92f0b84c5644a0c6394 in 58ms, sequenceid=5, compaction requested=false 2023-02-07 14:03:31,698 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bcca6b76fa34a92f0b84c5644a0c6394: 2023-02-07 14:03:31,698 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-07 14:03:31,698 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 14:03:31,698 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1/85cc82af41da44c7bfe4505715db6890] hfiles 2023-02-07 14:03:31,698 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1/85cc82af41da44c7bfe4505715db6890 for snapshot=testWithMapReduceSingleRegion 2023-02-07 14:03:31,698 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2/2ae26a7bfe524294bb233d719da9ab00] hfiles 2023-02-07 14:03:31,698 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2/2ae26a7bfe524294bb233d719da9ab00 for snapshot=testWithMapReduceSingleRegion 2023-02-07 14:03:31,707 DEBUG [Listener at localhost/33577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:31,707 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:31,707 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:31,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 14:03:31,709 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. completed. 2023-02-07 14:03:31,709 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:31,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-07 14:03:31,709 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-07 14:03:31,709 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-07 14:03:31,709 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,709 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-07 14:03:31,709 DEBUG [Listener at localhost/33577] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 14:03:31,709 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34393,1675778609790' in zk 2023-02-07 14:03:31,711 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-07 14:03:31,711 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,711 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:31,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,711 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-07 14:03:31,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:31,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:31,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 14:03:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 14:03:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,34393,1675778609790': 2023-02-07 14:03:31,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34393,1675778609790' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-07 14:03:31,715 INFO [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-07 14:03:31,715 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:03:31,715 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:03:31,715 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-07 14:03:31,715 INFO [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 14:03:31,716 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,716 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,717 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:31,717 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,716 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 14:03:31,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:31,717 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:31,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:31,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,718 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 14:03:31,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:31,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 14:03:31,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:31,719 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:31,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,720 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:31,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-07 14:03:31,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:31,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,727 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,727 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:31,727 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 14:03:31,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:31,727 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:31,727 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-07 14:03:31,727 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 14:03:31,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-07 14:03:31,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 14:03:31,727 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:31,727 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 14:03:31,727 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 14:03:31,727 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-07 14:03:31,727 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:31,727 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 14:03:31,727 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:31,727 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-07 14:03:31,727 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-07 14:03:31,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:31,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:31,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-07 14:03:31,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 14:03:31,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 14:03:31,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-07 14:03:31,764 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-07 14:03:31,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-07 14:03:31,765 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-07 14:03:31,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1675778611604Consolidate snapshot: testWithMapReduceSingleRegion at 1675778611727 (+123 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1675778611727Writing data manifest for testWithMapReduceSingleRegion at 1675778611730 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1675778611742 (+12 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1675778611764 (+22 ms) 2023-02-07 14:03:31,765 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-07 14:03:31,766 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 158 msec 2023-02-07 14:03:31,909 DEBUG [Listener at localhost/33577] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 14:03:31,909 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:31,910 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:31,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-07 14:03:31,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 14:03:31,911 INFO [Listener at localhost/33577] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-07 14:03:31,911 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:31,911 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:31,915 INFO [Listener at localhost/33577] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-07 14:03:31,921 INFO [Listener at localhost/33577] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-07 14:03:32,001 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34393] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:32,081 INFO [Listener at localhost/33577] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-07 14:03:32,084 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:32,084 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:32,086 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-07 14:03:32,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-07 14:03:32,088 INFO [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-07 14:03:32,088 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:32,088 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-07 14:03:32,088 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-07 14:03:32,088 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,088 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:32,089 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:32,089 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:32,089 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:32,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:32,090 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,090 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 14:03:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:32,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:03:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 14:03:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:32,090 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 14:03:32,090 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-07 14:03:32,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 14:03:32,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-07 14:03:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 14:03:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 14:03:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 14:03:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-07 14:03:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 14:03:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40007,1675778609818' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 14:03:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-07 14:03:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 14:03:32,091 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 14:03:32,091 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:32,091 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. started... 2023-02-07 14:03:32,091 INFO [rs(jenkins-hbase4.apache.org,34393,1675778609790)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bcca6b76fa34a92f0b84c5644a0c6394 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-07 14:03:32,092 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:32,092 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:32,093 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:32,109 INFO [rs(jenkins-hbase4.apache.org,34393,1675778609790)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/.tmp/f1/6ff4473961ff4a62a6632c17c94243ac 2023-02-07 14:03:32,127 INFO [rs(jenkins-hbase4.apache.org,34393,1675778609790)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/.tmp/f2/e99ad289eef64a8f821eccff96d8fac7 2023-02-07 14:03:32,132 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/.tmp/f1/6ff4473961ff4a62a6632c17c94243ac as hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1/6ff4473961ff4a62a6632c17c94243ac 2023-02-07 14:03:32,136 INFO [rs(jenkins-hbase4.apache.org,34393,1675778609790)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1/6ff4473961ff4a62a6632c17c94243ac, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 14:03:32,137 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/.tmp/f2/e99ad289eef64a8f821eccff96d8fac7 as hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2/e99ad289eef64a8f821eccff96d8fac7 2023-02-07 14:03:32,141 INFO [rs(jenkins-hbase4.apache.org,34393,1675778609790)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2/e99ad289eef64a8f821eccff96d8fac7, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-07 14:03:32,142 INFO [rs(jenkins-hbase4.apache.org,34393,1675778609790)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for bcca6b76fa34a92f0b84c5644a0c6394 in 50ms, sequenceid=9, compaction requested=false 2023-02-07 14:03:32,142 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bcca6b76fa34a92f0b84c5644a0c6394: 2023-02-07 14:03:32,142 DEBUG [rs(jenkins-hbase4.apache.org,34393,1675778609790)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:32,142 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 14:03:32,142 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 14:03:32,142 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,142 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-07 14:03:32,142 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34393,1675778609790' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-07 14:03:32,143 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:32,143 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:32,144 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:32,144 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 14:03:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:32,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34393,1675778609790' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-07 14:03:32,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48ef6ec4[Count = 0] remaining members to acquire global barrier 2023-02-07 14:03:32,146 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-07 14:03:32,146 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:32,148 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:32,148 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:32,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:32,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:32,148 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 14:03:32,148 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-07 14:03:32,149 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 14:03:32,148 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,149 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 14:03:32,149 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,40007,1675778609818' in zk 2023-02-07 14:03:32,148 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-07 14:03:32,149 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,34393,1675778609790' in zk 2023-02-07 14:03:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 14:03:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-07 14:03:32,150 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:32,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:32,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,34393,1675778609790' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 14:03:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,40007,1675778609818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-07 14:03:32,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:32,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:32,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:32,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:32,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:32,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:32,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:32,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,34393,1675778609790': 2023-02-07 14:03:32,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34393,1675778609790' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-07 14:03:32,153 INFO [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-07 14:03:32,153 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 14:03:32,153 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 14:03:32,153 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-07 14:03:32,153 INFO [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 14:03:32,155 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,155 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 14:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 14:03:32,155 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:32,155 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 14:03:32,155 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:32,156 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:32,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:32,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:32,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:32,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:32,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:32,156 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 14:03:32,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:32,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:32,157 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:32,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,158 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 14:03:32,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-07 14:03:32,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:32,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,160 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:32,160 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 14:03:32,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:32,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 14:03:32,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:32,161 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,161 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-07 14:03:32,161 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 14:03:32,161 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:32,160 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 14:03:32,161 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:32,161 DEBUG [(jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 14:03:32,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 14:03:32,161 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:32,161 DEBUG [Listener at localhost/33577] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-07 14:03:32,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:32,162 DEBUG [Listener at localhost/33577] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 14:03:32,161 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-07 14:03:32,162 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:32,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 14:03:32,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:32,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 14:03:32,162 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:32,162 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:32,162 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-07 14:03:32,162 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-07 14:03:32,262 DEBUG [Listener at localhost/33577] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 14:03:32,262 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:32,262 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:32,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 14:03:32,350 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/hadoop-7956369092795853865.jar 2023-02-07 14:03:32,354 INFO [Listener at localhost/33577] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675778611587 type: FLUSH version: 2 ttl: 0 2023-02-07 14:03:32,354 DEBUG [Listener at localhost/33577] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35931/user/jenkins/test-data/5150faf3-f18e-1ab5-ac23-638be24ebc37/testWithMapReduceSingleRegion/acd4bab6-ec5e-4ce7-805c-eb2b4dc2f029/data/default/testWithMapReduce 2023-02-07 14:03:32,354 INFO [Listener at localhost/33577] snapshot.RestoreSnapshotHelper(239): region to add: bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:32,354 INFO [Listener at localhost/33577] snapshot.RestoreSnapshotHelper(585): clone region=bcca6b76fa34a92f0b84c5644a0c6394 as bcca6b76fa34a92f0b84c5644a0c6394 in snapshot testWithMapReduceSingleRegion 2023-02-07 14:03:32,355 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => bcca6b76fa34a92f0b84c5644a0c6394, NAME => 'testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35931/user/jenkins/test-data/5150faf3-f18e-1ab5-ac23-638be24ebc37/testWithMapReduceSingleRegion/acd4bab6-ec5e-4ce7-805c-eb2b4dc2f029 2023-02-07 14:03:32,361 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:32,361 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 85cc82af41da44c7bfe4505715db6890 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-07 14:03:32,363 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2ae26a7bfe524294bb233d719da9ab00 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-07 14:03:32,365 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing bcca6b76fa34a92f0b84c5644a0c6394, disabling compactions & flushes 2023-02-07 14:03:32,365 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:32,365 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:32,365 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. after waiting 0 ms 2023-02-07 14:03:32,365 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:32,365 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:32,366 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for bcca6b76fa34a92f0b84c5644a0c6394: Waiting for close lock at 1675778612365Disabling compacts and flushes for region at 1675778612365Disabling writes for close at 1675778612365Writing region close event to WAL at 1675778612365Closed at 1675778612365 2023-02-07 14:03:32,366 INFO [Listener at localhost/33577] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1675778611587 type: FLUSH version: 2 ttl: 0 2023-02-07 14:03:32,366 DEBUG [Listener at localhost/33577] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35931/user/jenkins/test-data/5150faf3-f18e-1ab5-ac23-638be24ebc37/testWithMapReduceSingleRegion/acd4bab6-ec5e-4ce7-805c-eb2b4dc2f029 2023-02-07 14:03:32,366 DEBUG [Listener at localhost/33577] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35931/user/jenkins/test-data/5150faf3-f18e-1ab5-ac23-638be24ebc37/testWithMapReduceSingleRegion/acd4bab6-ec5e-4ce7-805c-eb2b4dc2f029 2023-02-07 14:03:32,366 DEBUG [Listener at localhost/33577] util.CommonFSUtils(699): |-data/ 2023-02-07 14:03:32,367 DEBUG [Listener at localhost/33577] util.CommonFSUtils(699): |----default/ 2023-02-07 14:03:32,367 DEBUG [Listener at localhost/33577] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-07 14:03:32,367 DEBUG [Listener at localhost/33577] util.CommonFSUtils(699): |----------bcca6b76fa34a92f0b84c5644a0c6394/ 2023-02-07 14:03:32,368 DEBUG [Listener at localhost/33577] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-07 14:03:32,368 DEBUG [Listener at localhost/33577] util.CommonFSUtils(699): |-------------f1/ 2023-02-07 14:03:32,368 DEBUG [Listener at localhost/33577] util.CommonFSUtils(702): |----------------testWithMapReduce=bcca6b76fa34a92f0b84c5644a0c6394-85cc82af41da44c7bfe4505715db6890 2023-02-07 14:03:32,368 DEBUG [Listener at localhost/33577] util.CommonFSUtils(699): |-------------f2/ 2023-02-07 14:03:32,369 DEBUG [Listener at localhost/33577] util.CommonFSUtils(702): |----------------testWithMapReduce=bcca6b76fa34a92f0b84c5644a0c6394-2ae26a7bfe524294bb233d719da9ab00 2023-02-07 14:03:32,369 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:32,370 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:32,370 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:32,371 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:33,427 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/hadoop-7236013993080039096.jar 2023-02-07 14:03:33,428 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:33,428 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:33,526 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/hadoop-7186709063722215362.jar 2023-02-07 14:03:33,526 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:33,527 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:33,528 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:33,528 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:33,529 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:33,529 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:33,530 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-07 14:03:33,530 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-07 14:03:33,531 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-07 14:03:33,532 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-07 14:03:33,532 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-07 14:03:33,533 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-07 14:03:33,534 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-07 14:03:33,534 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-07 14:03:33,535 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-07 14:03:33,535 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-07 14:03:33,536 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-07 14:03:33,537 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 14:03:33,537 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 14:03:33,538 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-07 14:03:33,539 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 14:03:33,637 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/hadoop-7699646139889321228.jar 2023-02-07 14:03:33,638 DEBUG [Listener at localhost/33577] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-07 14:03:33,644 WARN [Listener at localhost/33577] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-07 14:03:33,650 WARN [Listener at localhost/33577] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-07 14:03:33,662 INFO [Listener at localhost/33577] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-07 14:03:33,751 WARN [Listener at localhost/33577] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/mapreduce.cluster.local.dir/1675778613715/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-07 14:03:33,752 WARN [Listener at localhost/33577] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/mapreduce.cluster.local.dir/1675778613715/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-07 14:03:33,786 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 14:03:33,787 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-07 14:03:33,787 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 14:03:33,793 INFO [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:33,794 DEBUG [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/5150faf3-f18e-1ab5-ac23-638be24ebc37/testWithMapReduceSingleRegion/acd4bab6-ec5e-4ce7-805c-eb2b4dc2f029/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1 2023-02-07 14:03:33,794 INFO [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcca6b76fa34a92f0b84c5644a0c6394 columnFamilyName f1 2023-02-07 14:03:33,799 DEBUG [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] regionserver.HStore(539): loaded hdfs://localhost:35931/user/jenkins/test-data/5150faf3-f18e-1ab5-ac23-638be24ebc37/testWithMapReduceSingleRegion/acd4bab6-ec5e-4ce7-805c-eb2b4dc2f029/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1/testWithMapReduce=bcca6b76fa34a92f0b84c5644a0c6394-85cc82af41da44c7bfe4505715db6890 2023-02-07 14:03:33,799 INFO [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] regionserver.HStore(310): Store=bcca6b76fa34a92f0b84c5644a0c6394/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:33,800 INFO [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:33,800 DEBUG [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35931/user/jenkins/test-data/5150faf3-f18e-1ab5-ac23-638be24ebc37/testWithMapReduceSingleRegion/acd4bab6-ec5e-4ce7-805c-eb2b4dc2f029/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2 2023-02-07 14:03:33,801 INFO [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcca6b76fa34a92f0b84c5644a0c6394 columnFamilyName f2 2023-02-07 14:03:33,805 DEBUG [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] regionserver.HStore(539): loaded hdfs://localhost:35931/user/jenkins/test-data/5150faf3-f18e-1ab5-ac23-638be24ebc37/testWithMapReduceSingleRegion/acd4bab6-ec5e-4ce7-805c-eb2b4dc2f029/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2/testWithMapReduce=bcca6b76fa34a92f0b84c5644a0c6394-2ae26a7bfe524294bb233d719da9ab00 2023-02-07 14:03:33,805 INFO [StoreOpener-bcca6b76fa34a92f0b84c5644a0c6394-1] regionserver.HStore(310): Store=bcca6b76fa34a92f0b84c5644a0c6394/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 14:03:33,805 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 14:03:33,805 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bcca6b76fa34a92f0b84c5644a0c6394; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62691171, jitterRate=-0.06582875549793243}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 14:03:33,805 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bcca6b76fa34a92f0b84c5644a0c6394: Writing region info on filesystem at 1675778613787Initializing all the Stores at 1675778613791 (+4 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778613791Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675778613792 (+1 ms)Region opened successfully at 1675778613805 (+13 ms) 2023-02-07 14:03:33,893 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bcca6b76fa34a92f0b84c5644a0c6394, disabling compactions & flushes 2023-02-07 14:03:33,893 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:33,893 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:33,893 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. after waiting 0 ms 2023-02-07 14:03:33,893 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:33,894 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:33,894 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bcca6b76fa34a92f0b84c5644a0c6394: Waiting for close lock at 1675778613893Disabling compacts and flushes for region at 1675778613893Disabling writes for close at 1675778613893Writing region close event to WAL at 1675778613894 (+1 ms)Closed at 1675778613894 2023-02-07 14:03:34,794 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:34,795 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:34,796 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-07 14:03:34,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-07 14:03:34,799 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:34,800 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:34,800 INFO [Listener at localhost/33577] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-07 14:03:34,801 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-07 14:03:34,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-07 14:03:34,803 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:34,804 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:34,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 14:03:34,809 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778614809"}]},"ts":"1675778614809"} 2023-02-07 14:03:34,810 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-07 14:03:34,814 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-07 14:03:34,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bcca6b76fa34a92f0b84c5644a0c6394, UNASSIGN}] 2023-02-07 14:03:34,815 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bcca6b76fa34a92f0b84c5644a0c6394, UNASSIGN 2023-02-07 14:03:34,816 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bcca6b76fa34a92f0b84c5644a0c6394, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:34,816 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675778614816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675778614816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675778614816"}]},"ts":"1675778614816"} 2023-02-07 14:03:34,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure bcca6b76fa34a92f0b84c5644a0c6394, server=jenkins-hbase4.apache.org,34393,1675778609790}] 2023-02-07 14:03:34,905 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:34,905 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:34,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 14:03:34,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:34,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bcca6b76fa34a92f0b84c5644a0c6394, disabling compactions & flushes 2023-02-07 14:03:34,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:34,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:34,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. after waiting 0 ms 2023-02-07 14:03:34,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:34,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-07 14:03:34,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394. 2023-02-07 14:03:34,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bcca6b76fa34a92f0b84c5644a0c6394: Waiting for close lock at 1675778614970Running coprocessor pre-close hooks at 1675778614970Disabling compacts and flushes for region at 1675778614970Disabling writes for close at 1675778614970Writing region close event to WAL at 1675778614980 (+10 ms)Running coprocessor post-close hooks at 1675778614985 (+5 ms)Closed at 1675778614985 2023-02-07 14:03:34,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:34,987 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bcca6b76fa34a92f0b84c5644a0c6394, regionState=CLOSED 2023-02-07 14:03:34,987 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1675778614987"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675778614987"}]},"ts":"1675778614987"} 2023-02-07 14:03:34,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-07 14:03:34,991 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure bcca6b76fa34a92f0b84c5644a0c6394, server=jenkins-hbase4.apache.org,34393,1675778609790 in 172 msec 2023-02-07 14:03:34,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-07 14:03:34,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bcca6b76fa34a92f0b84c5644a0c6394, UNASSIGN in 177 msec 2023-02-07 14:03:34,994 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675778614994"}]},"ts":"1675778614994"} 2023-02-07 14:03:34,996 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-07 14:03:35,003 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-07 14:03:35,066 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 263 msec 2023-02-07 14:03:35,107 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:35,107 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:35,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-07 14:03:35,109 INFO [Listener at localhost/33577] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-07 14:03:35,109 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:35,109 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:35,110 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-07 14:03:35,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-07 14:03:35,114 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 14:03:35,114 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:35,114 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:35,115 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 14:03:35,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 14:03:35,118 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:35,120 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1, FileablePath, hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2, FileablePath, hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/recovered.edits] 2023-02-07 14:03:35,124 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1/6ff4473961ff4a62a6632c17c94243ac to hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/archive/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1/6ff4473961ff4a62a6632c17c94243ac 2023-02-07 14:03:35,126 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1/85cc82af41da44c7bfe4505715db6890 to hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/archive/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f1/85cc82af41da44c7bfe4505715db6890 2023-02-07 14:03:35,128 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2/2ae26a7bfe524294bb233d719da9ab00 to hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/archive/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2/2ae26a7bfe524294bb233d719da9ab00 2023-02-07 14:03:35,130 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2/e99ad289eef64a8f821eccff96d8fac7 to hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/archive/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/f2/e99ad289eef64a8f821eccff96d8fac7 2023-02-07 14:03:35,136 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/recovered.edits/12.seqid to hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/archive/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394/recovered.edits/12.seqid 2023-02-07 14:03:35,136 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/.tmp/data/default/testWithMapReduce/bcca6b76fa34a92f0b84c5644a0c6394 2023-02-07 14:03:35,136 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-07 14:03:35,138 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 14:03:35,140 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-07 14:03:35,142 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-07 14:03:35,145 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 14:03:35,145 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-07 14:03:35,145 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675778615145"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:35,152 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-07 14:03:35,152 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bcca6b76fa34a92f0b84c5644a0c6394, NAME => 'testWithMapReduce,,1675778610852.bcca6b76fa34a92f0b84c5644a0c6394.', STARTKEY => '', ENDKEY => ''}] 2023-02-07 14:03:35,152 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-07 14:03:35,152 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675778615152"}]},"ts":"9223372036854775807"} 2023-02-07 14:03:35,155 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-07 14:03:35,157 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-07 14:03:35,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 47 msec 2023-02-07 14:03:35,216 INFO [Listener at localhost/33577] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 14:03:35,216 INFO [Listener at localhost/33577] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 14:03:35,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-07 14:03:35,217 INFO [Listener at localhost/33577] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-07 14:03:35,218 INFO [Listener at localhost/33577] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 14:03:35,218 INFO [Listener at localhost/33577] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 14:03:35,218 DEBUG [Listener at localhost/33577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06fefa53 to 127.0.0.1:51996 2023-02-07 14:03:35,218 DEBUG [Listener at localhost/33577] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:35,218 DEBUG [Listener at localhost/33577] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 14:03:35,218 DEBUG [Listener at localhost/33577] util.JVMClusterUtil(257): Found active master hash=1313928598, stopped=false 2023-02-07 14:03:35,218 INFO [Listener at localhost/33577] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41631,1675778609742 2023-02-07 14:03:35,222 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:35,222 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:35,222 INFO [Listener at localhost/33577] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 14:03:35,222 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 14:03:35,224 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:35,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:35,224 DEBUG [Listener at localhost/33577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07c776a8 to 127.0.0.1:51996 2023-02-07 14:03:35,224 DEBUG [Listener at localhost/33577] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:35,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:35,224 INFO [Listener at localhost/33577] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34393,1675778609790' ***** 2023-02-07 14:03:35,225 INFO [Listener at localhost/33577] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:03:35,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 14:03:35,225 INFO [Listener at localhost/33577] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40007,1675778609818' ***** 2023-02-07 14:03:35,225 INFO [Listener at localhost/33577] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 14:03:35,225 INFO [RS:0;jenkins-hbase4:34393] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:03:35,225 INFO [RS:0;jenkins-hbase4:34393] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:03:35,225 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:03:35,225 INFO [RS:0;jenkins-hbase4:34393] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:03:35,230 INFO [RS:1;jenkins-hbase4:40007] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 14:03:35,230 INFO [RS:1;jenkins-hbase4:40007] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 14:03:35,230 INFO [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:35,230 INFO [RS:1;jenkins-hbase4:40007] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 14:03:35,230 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 14:03:35,231 INFO [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(3304): Received CLOSE for f57b37e13d0960b889de7298b4cc2485 2023-02-07 14:03:35,230 DEBUG [RS:0;jenkins-hbase4:34393] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58699197 to 127.0.0.1:51996 2023-02-07 14:03:35,231 DEBUG [RS:0;jenkins-hbase4:34393] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:35,231 INFO [RS:0;jenkins-hbase4:34393] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:03:35,231 INFO [RS:0;jenkins-hbase4:34393] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:03:35,231 INFO [RS:0;jenkins-hbase4:34393] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:03:35,231 INFO [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 14:03:35,232 INFO [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:35,232 DEBUG [RS:1;jenkins-hbase4:40007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ee76393 to 127.0.0.1:51996 2023-02-07 14:03:35,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f57b37e13d0960b889de7298b4cc2485, disabling compactions & flushes 2023-02-07 14:03:35,233 INFO [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 14:03:35,233 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 14:03:35,233 DEBUG [RS:1;jenkins-hbase4:40007] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:35,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 14:03:35,234 DEBUG [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-07 14:03:35,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. 2023-02-07 14:03:35,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 14:03:35,234 INFO [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-07 14:03:35,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 14:03:35,234 DEBUG [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 14:03:35,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. 2023-02-07 14:03:35,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 14:03:35,234 DEBUG [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(1479): Online Regions={f57b37e13d0960b889de7298b4cc2485=hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485.} 2023-02-07 14:03:35,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-07 14:03:35,234 DEBUG [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(1505): Waiting on f57b37e13d0960b889de7298b4cc2485 2023-02-07 14:03:35,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. after waiting 0 ms 2023-02-07 14:03:35,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. 2023-02-07 14:03:35,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing f57b37e13d0960b889de7298b4cc2485 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-07 14:03:35,259 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/.tmp/info/2dbe59faf52a4c149416e2e95462741a 2023-02-07 14:03:35,264 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dbe59faf52a4c149416e2e95462741a 2023-02-07 14:03:35,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/namespace/f57b37e13d0960b889de7298b4cc2485/.tmp/info/8751c31bf21f46b0957d134518d30cc2 2023-02-07 14:03:35,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/namespace/f57b37e13d0960b889de7298b4cc2485/.tmp/info/8751c31bf21f46b0957d134518d30cc2 as hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/namespace/f57b37e13d0960b889de7298b4cc2485/info/8751c31bf21f46b0957d134518d30cc2 2023-02-07 14:03:35,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/namespace/f57b37e13d0960b889de7298b4cc2485/info/8751c31bf21f46b0957d134518d30cc2, entries=2, sequenceid=6, filesize=4.8 K 2023-02-07 14:03:35,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f57b37e13d0960b889de7298b4cc2485 in 44ms, sequenceid=6, compaction requested=false 2023-02-07 14:03:35,291 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:35,292 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:35,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/namespace/f57b37e13d0960b889de7298b4cc2485/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-07 14:03:35,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. 2023-02-07 14:03:35,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f57b37e13d0960b889de7298b4cc2485: Waiting for close lock at 1675778615232Running coprocessor pre-close hooks at 1675778615232Disabling compacts and flushes for region at 1675778615232Disabling writes for close at 1675778615234 (+2 ms)Obtaining lock to block concurrent updates at 1675778615234Preparing flush snapshotting stores in f57b37e13d0960b889de7298b4cc2485 at 1675778615234Finished memstore snapshotting hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1675778615235 (+1 ms)Flushing stores of hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. at 1675778615235Flushing f57b37e13d0960b889de7298b4cc2485/info: creating writer at 1675778615235Flushing f57b37e13d0960b889de7298b4cc2485/info: appending metadata at 1675778615237 (+2 ms)Flushing f57b37e13d0960b889de7298b4cc2485/info: closing flushed file at 1675778615237Flushing f57b37e13d0960b889de7298b4cc2485/info: reopening flushed file at 1675778615273 (+36 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for f57b37e13d0960b889de7298b4cc2485 in 44ms, sequenceid=6, compaction requested=false at 1675778615278 (+5 ms)Writing region close event to WAL at 1675778615306 (+28 ms)Running coprocessor post-close hooks at 1675778615317 (+11 ms)Closed at 1675778615318 (+1 ms) 2023-02-07 14:03:35,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675778610359.f57b37e13d0960b889de7298b4cc2485. 2023-02-07 14:03:35,320 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/.tmp/rep_barrier/1ff5646cf7034e86a33fc5c4dd16f458 2023-02-07 14:03:35,324 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ff5646cf7034e86a33fc5c4dd16f458 2023-02-07 14:03:35,336 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/.tmp/table/c1826708c9224d589b5ac804273b4607 2023-02-07 14:03:35,340 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c1826708c9224d589b5ac804273b4607 2023-02-07 14:03:35,340 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/.tmp/info/2dbe59faf52a4c149416e2e95462741a as hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/info/2dbe59faf52a4c149416e2e95462741a 2023-02-07 14:03:35,344 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dbe59faf52a4c149416e2e95462741a 2023-02-07 14:03:35,344 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/info/2dbe59faf52a4c149416e2e95462741a, entries=12, sequenceid=21, filesize=6.2 K 2023-02-07 14:03:35,347 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/.tmp/rep_barrier/1ff5646cf7034e86a33fc5c4dd16f458 as hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/rep_barrier/1ff5646cf7034e86a33fc5c4dd16f458 2023-02-07 14:03:35,351 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ff5646cf7034e86a33fc5c4dd16f458 2023-02-07 14:03:35,351 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/rep_barrier/1ff5646cf7034e86a33fc5c4dd16f458, entries=1, sequenceid=21, filesize=5.0 K 2023-02-07 14:03:35,352 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/.tmp/table/c1826708c9224d589b5ac804273b4607 as hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/table/c1826708c9224d589b5ac804273b4607 2023-02-07 14:03:35,355 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c1826708c9224d589b5ac804273b4607 2023-02-07 14:03:35,355 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/table/c1826708c9224d589b5ac804273b4607, entries=4, sequenceid=21, filesize=5.0 K 2023-02-07 14:03:35,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 122ms, sequenceid=21, compaction requested=false 2023-02-07 14:03:35,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-07 14:03:35,373 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 14:03:35,375 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:35,375 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675778615233Running coprocessor pre-close hooks at 1675778615233Disabling compacts and flushes for region at 1675778615233Disabling writes for close at 1675778615234 (+1 ms)Obtaining lock to block concurrent updates at 1675778615234Preparing flush snapshotting stores in 1588230740 at 1675778615234Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1675778615235 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675778615235Flushing 1588230740/info: creating writer at 1675778615235Flushing 1588230740/info: appending metadata at 1675778615238 (+3 ms)Flushing 1588230740/info: closing flushed file at 1675778615238Flushing 1588230740/rep_barrier: creating writer at 1675778615264 (+26 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675778615279 (+15 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675778615279Flushing 1588230740/table: creating writer at 1675778615324 (+45 ms)Flushing 1588230740/table: appending metadata at 1675778615325 (+1 ms)Flushing 1588230740/table: closing flushed file at 1675778615326 (+1 ms)Flushing 1588230740/info: reopening flushed file at 1675778615341 (+15 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675778615347 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1675778615352 (+5 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 122ms, sequenceid=21, compaction requested=false at 1675778615356 (+4 ms)Writing region close event to WAL at 1675778615370 (+14 ms)Running coprocessor post-close hooks at 1675778615373 (+3 ms)Closed at 1675778615375 (+2 ms) 2023-02-07 14:03:35,375 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 14:03:35,434 INFO [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34393,1675778609790; all regions closed. 2023-02-07 14:03:35,434 INFO [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40007,1675778609818; all regions closed. 2023-02-07 14:03:35,439 DEBUG [RS:0;jenkins-hbase4:34393] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/oldWALs 2023-02-07 14:03:35,439 INFO [RS:0;jenkins-hbase4:34393] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34393%2C1675778609790.meta:.meta(num 1675778610311) 2023-02-07 14:03:35,439 DEBUG [RS:1;jenkins-hbase4:40007] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/oldWALs 2023-02-07 14:03:35,439 INFO [RS:1;jenkins-hbase4:40007] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40007%2C1675778609818:(num 1675778610706) 2023-02-07 14:03:35,439 DEBUG [RS:1;jenkins-hbase4:40007] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:35,439 INFO [RS:1;jenkins-hbase4:40007] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:35,440 INFO [RS:1;jenkins-hbase4:40007] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 14:03:35,440 INFO [RS:1;jenkins-hbase4:40007] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 14:03:35,440 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:35,440 INFO [RS:1;jenkins-hbase4:40007] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 14:03:35,440 INFO [RS:1;jenkins-hbase4:40007] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 14:03:35,441 INFO [RS:1;jenkins-hbase4:40007] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40007 2023-02-07 14:03:35,443 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:35,443 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:35,443 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40007,1675778609818 2023-02-07 14:03:35,443 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:35,443 ERROR [Listener at localhost/33577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25c49469 rejected from java.util.concurrent.ThreadPoolExecutor@21fb0409[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:35,444 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:35,444 ERROR [Listener at localhost/33577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@54b15d13 rejected from java.util.concurrent.ThreadPoolExecutor@21fb0409[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:35,444 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40007,1675778609818] 2023-02-07 14:03:35,444 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40007,1675778609818; numProcessing=1 2023-02-07 14:03:35,444 DEBUG [RS:0;jenkins-hbase4:34393] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/oldWALs 2023-02-07 14:03:35,444 INFO [RS:0;jenkins-hbase4:34393] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34393%2C1675778609790:(num 1675778611123) 2023-02-07 14:03:35,444 DEBUG [RS:0;jenkins-hbase4:34393] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:35,444 INFO [RS:0;jenkins-hbase4:34393] regionserver.LeaseManager(133): Closed leases 2023-02-07 14:03:35,444 INFO [RS:0;jenkins-hbase4:34393] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-07 14:03:35,445 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:35,447 INFO [RS:0;jenkins-hbase4:34393] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34393 2023-02-07 14:03:35,447 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40007,1675778609818 already deleted, retry=false 2023-02-07 14:03:35,447 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40007,1675778609818 expired; onlineServers=1 2023-02-07 14:03:35,545 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:35,545 INFO [RS:1;jenkins-hbase4:40007] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40007,1675778609818; zookeeper connection closed. 2023-02-07 14:03:35,545 ERROR [Listener at localhost/33577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2cf561df rejected from java.util.concurrent.ThreadPoolExecutor@21fb0409[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:35,545 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:40007-0x1002f183c000002, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:35,545 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@76381e7a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@76381e7a 2023-02-07 14:03:35,545 ERROR [Listener at localhost/33577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5ad1fd51 rejected from java.util.concurrent.ThreadPoolExecutor@21fb0409[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:35,547 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34393,1675778609790 2023-02-07 14:03:35,547 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 14:03:35,547 ERROR [Listener at localhost/33577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ba3e802 rejected from java.util.concurrent.ThreadPoolExecutor@2f9c79ae[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:35,547 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34393,1675778609790] 2023-02-07 14:03:35,547 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34393,1675778609790; numProcessing=2 2023-02-07 14:03:35,550 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34393,1675778609790 already deleted, retry=false 2023-02-07 14:03:35,550 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34393,1675778609790 expired; onlineServers=0 2023-02-07 14:03:35,550 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41631,1675778609742' ***** 2023-02-07 14:03:35,550 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 14:03:35,551 DEBUG [M:0;jenkins-hbase4:41631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a6f6884, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-07 14:03:35,551 INFO [M:0;jenkins-hbase4:41631] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41631,1675778609742 2023-02-07 14:03:35,551 INFO [M:0;jenkins-hbase4:41631] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41631,1675778609742; all regions closed. 2023-02-07 14:03:35,551 DEBUG [M:0;jenkins-hbase4:41631] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 14:03:35,551 DEBUG [M:0;jenkins-hbase4:41631] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 14:03:35,551 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 14:03:35,551 DEBUG [M:0;jenkins-hbase4:41631] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 14:03:35,551 INFO [M:0;jenkins-hbase4:41631] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 14:03:35,551 INFO [M:0;jenkins-hbase4:41631] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 14:03:35,551 INFO [M:0;jenkins-hbase4:41631] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-07 14:03:35,551 DEBUG [M:0;jenkins-hbase4:41631] master.HMaster(1502): Stopping service threads 2023-02-07 14:03:35,552 INFO [M:0;jenkins-hbase4:41631] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 14:03:35,552 ERROR [M:0;jenkins-hbase4:41631] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-07 14:03:35,552 INFO [M:0;jenkins-hbase4:41631] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 14:03:35,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778609958] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1675778609958,5,FailOnTimeoutGroup] 2023-02-07 14:03:35,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778609958] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1675778609958,5,FailOnTimeoutGroup] 2023-02-07 14:03:35,553 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 14:03:35,556 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 14:03:35,556 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 14:03:35,556 DEBUG [M:0;jenkins-hbase4:41631] zookeeper.ZKUtil(398): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 14:03:35,556 WARN [M:0;jenkins-hbase4:41631] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 14:03:35,556 INFO [M:0;jenkins-hbase4:41631] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 14:03:35,557 INFO [M:0;jenkins-hbase4:41631] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 14:03:35,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 14:03:35,557 DEBUG [M:0;jenkins-hbase4:41631] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 14:03:35,557 INFO [M:0;jenkins-hbase4:41631] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:35,557 DEBUG [M:0;jenkins-hbase4:41631] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:35,557 DEBUG [M:0;jenkins-hbase4:41631] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 14:03:35,557 DEBUG [M:0;jenkins-hbase4:41631] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:35,557 INFO [M:0;jenkins-hbase4:41631] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.71 KB heapSize=65.67 KB 2023-02-07 14:03:35,570 INFO [M:0;jenkins-hbase4:41631] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.71 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5798b0ea1e3a4d3284d8c872cf402219 2023-02-07 14:03:35,579 DEBUG [M:0;jenkins-hbase4:41631] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5798b0ea1e3a4d3284d8c872cf402219 as hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5798b0ea1e3a4d3284d8c872cf402219 2023-02-07 14:03:35,584 INFO [M:0;jenkins-hbase4:41631] regionserver.HStore(1080): Added hdfs://localhost:35931/user/jenkins/test-data/f7e592a8-e97e-ce37-351f-f857a48c7432/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5798b0ea1e3a4d3284d8c872cf402219, entries=17, sequenceid=132, filesize=8.6 K 2023-02-07 14:03:35,585 INFO [M:0;jenkins-hbase4:41631] regionserver.HRegion(2947): Finished flush of dataSize ~54.71 KB/56025, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=132, compaction requested=false 2023-02-07 14:03:35,585 INFO [M:0;jenkins-hbase4:41631] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 14:03:35,585 DEBUG [M:0;jenkins-hbase4:41631] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675778615557Disabling compacts and flushes for region at 1675778615557Disabling writes for close at 1675778615557Obtaining lock to block concurrent updates at 1675778615557Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675778615557Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=56025, getHeapSize=67232, getOffHeapSize=0, getCellsCount=145 at 1675778615557Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675778615558 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675778615558Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675778615560 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675778615560Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675778615580 (+20 ms)Finished flush of dataSize ~54.71 KB/56025, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=132, compaction requested=false at 1675778615585 (+5 ms)Writing region close event to WAL at 1675778615585Closed at 1675778615585 2023-02-07 14:03:35,587 INFO [M:0;jenkins-hbase4:41631] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 14:03:35,587 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 14:03:35,587 INFO [M:0;jenkins-hbase4:41631] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41631 2023-02-07 14:03:35,589 DEBUG [M:0;jenkins-hbase4:41631] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41631,1675778609742 already deleted, retry=false 2023-02-07 14:03:35,723 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:35,723 INFO [M:0;jenkins-hbase4:41631] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41631,1675778609742; zookeeper connection closed. 2023-02-07 14:03:35,723 ERROR [Listener at localhost/33577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@40f5ba59 rejected from java.util.concurrent.ThreadPoolExecutor@44ca269f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:35,724 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): master:41631-0x1002f183c000000, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:35,724 ERROR [Listener at localhost/33577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d49c881 rejected from java.util.concurrent.ThreadPoolExecutor@44ca269f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:35,823 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:35,823 INFO [RS:0;jenkins-hbase4:34393] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34393,1675778609790; zookeeper connection closed. 2023-02-07 14:03:35,823 ERROR [Listener at localhost/33577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6f69ef56 rejected from java.util.concurrent.ThreadPoolExecutor@2f9c79ae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:35,824 DEBUG [Listener at localhost/33577-EventThread] zookeeper.ZKWatcher(600): regionserver:34393-0x1002f183c000001, quorum=127.0.0.1:51996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 14:03:35,824 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7f8437e7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7f8437e7 2023-02-07 14:03:35,824 ERROR [Listener at localhost/33577-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1723ba81 rejected from java.util.concurrent.ThreadPoolExecutor@2f9c79ae[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 14:03:35,824 INFO [Listener at localhost/33577] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-07 14:03:35,824 WARN [Listener at localhost/33577] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:03:35,830 INFO [Listener at localhost/33577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:35,932 WARN [BP-205182751-172.31.14.131-1675778609153 heartbeating to localhost/127.0.0.1:35931] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 14:03:35,932 WARN [BP-205182751-172.31.14.131-1675778609153 heartbeating to localhost/127.0.0.1:35931] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-205182751-172.31.14.131-1675778609153 (Datanode Uuid 7aeeff63-2f90-4a35-aa26-5c0ece5559b0) service to localhost/127.0.0.1:35931 2023-02-07 14:03:35,933 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/cluster_3872e920-1de6-efbb-82c1-f9e2c4fdc382/dfs/data/data3/current/BP-205182751-172.31.14.131-1675778609153] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:35,933 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/cluster_3872e920-1de6-efbb-82c1-f9e2c4fdc382/dfs/data/data4/current/BP-205182751-172.31.14.131-1675778609153] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:35,937 WARN [Listener at localhost/33577] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 14:03:35,946 INFO [Listener at localhost/33577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:35,947 WARN [BP-205182751-172.31.14.131-1675778609153 heartbeating to localhost/127.0.0.1:35931] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 14:03:35,947 WARN [BP-205182751-172.31.14.131-1675778609153 heartbeating to localhost/127.0.0.1:35931] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-205182751-172.31.14.131-1675778609153 (Datanode Uuid 7993f197-25cc-4da0-a297-bf3257aad78c) service to localhost/127.0.0.1:35931 2023-02-07 14:03:35,948 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/cluster_3872e920-1de6-efbb-82c1-f9e2c4fdc382/dfs/data/data1/current/BP-205182751-172.31.14.131-1675778609153] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:35,948 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a9ef473c-92eb-41bd-ac87-bcdd1a37aa95/cluster_3872e920-1de6-efbb-82c1-f9e2c4fdc382/dfs/data/data2/current/BP-205182751-172.31.14.131-1675778609153] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 14:03:35,960 INFO [Listener at localhost/33577] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 14:03:36,077 INFO [Listener at localhost/33577] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 14:03:36,095 INFO [Listener at localhost/33577] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-07 14:03:36,112 INFO [Listener at localhost/33577] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=292 (was 271) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:35931 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35931 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:35931 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,41631,1675778609742)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33577 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:35931 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:35931 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:35931 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1775694626) connection to localhost/127.0.0.1:35931 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=605 (was 575) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=323 (was 299) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=4693 (was 5367)