2023-02-13 20:03:18,667 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-13 20:03:18,710 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=242, MaxFileDescriptor=60000, SystemLoadAverage=150, ProcessCount=166, AvailableMemoryMB=2943 2023-02-13 20:03:18,990 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366 2023-02-13 20:03:18,997 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 20:03:18,998 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/cluster_7c69506b-0957-c1d7-85bd-d8f120766d1b, deleteOnExit=true 2023-02-13 20:03:18,998 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 20:03:18,998 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/test.cache.data in system properties and HBase conf 2023-02-13 20:03:18,999 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 20:03:18,999 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/hadoop.log.dir in system properties and HBase conf 2023-02-13 20:03:19,000 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 20:03:19,000 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 20:03:19,000 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 20:03:19,115 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-13 20:03:19,494 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 20:03:19,498 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:03:19,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:03:19,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 20:03:19,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:03:19,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 20:03:19,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 20:03:19,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:03:19,500 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:03:19,501 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 20:03:19,501 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/nfs.dump.dir in system properties and HBase conf 2023-02-13 20:03:19,501 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/java.io.tmpdir in system properties and HBase conf 2023-02-13 20:03:19,501 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:03:19,502 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 20:03:19,502 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 20:03:19,985 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:03:19,989 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:03:20,256 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 20:03:20,428 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-13 20:03:20,441 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:03:20,477 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:03:20,508 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/java.io.tmpdir/Jetty_localhost_36951_hdfs____wqdgjg/webapp 2023-02-13 20:03:20,645 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36951 2023-02-13 20:03:20,658 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:03:20,658 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:03:21,145 WARN [Listener at localhost/36203] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:03:21,232 WARN [Listener at localhost/36203] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:03:21,251 WARN [Listener at localhost/36203] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:03:21,257 INFO [Listener at localhost/36203] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:03:21,262 INFO [Listener at localhost/36203] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/java.io.tmpdir/Jetty_localhost_37965_datanode____al39ob/webapp 2023-02-13 20:03:21,377 INFO [Listener at localhost/36203] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37965 2023-02-13 20:03:21,804 WARN [Listener at localhost/37397] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:03:21,889 WARN [Listener at localhost/37397] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:03:21,892 WARN [Listener at localhost/37397] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:03:21,894 INFO [Listener at localhost/37397] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:03:21,910 INFO [Listener at localhost/37397] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/java.io.tmpdir/Jetty_localhost_36761_datanode____.bfbrmy/webapp 2023-02-13 20:03:22,024 INFO [Listener at localhost/37397] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36761 2023-02-13 20:03:22,044 WARN [Listener at localhost/39331] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:03:22,380 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x71e6f4c87a0f2754: Processing first storage report for DS-b1e05c86-4e1c-4e62-8def-982669cac8f4 from datanode dc2dda6d-cf86-4de4-8687-b125e63263c8 2023-02-13 20:03:22,382 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x71e6f4c87a0f2754: from storage DS-b1e05c86-4e1c-4e62-8def-982669cac8f4 node DatanodeRegistration(127.0.0.1:40177, datanodeUuid=dc2dda6d-cf86-4de4-8687-b125e63263c8, infoPort=39321, infoSecurePort=0, ipcPort=37397, storageInfo=lv=-57;cid=testClusterID;nsid=1496906999;c=1676318600054), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-13 20:03:22,383 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe5ee7aec2eaaf3f6: Processing first storage report for DS-7abc0ed0-f07d-482a-bde8-a3a180d66d6b from datanode 7df4099f-e054-42f3-9b42-4e78fdb49ccd 2023-02-13 20:03:22,383 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe5ee7aec2eaaf3f6: from storage DS-7abc0ed0-f07d-482a-bde8-a3a180d66d6b node DatanodeRegistration(127.0.0.1:33039, datanodeUuid=7df4099f-e054-42f3-9b42-4e78fdb49ccd, infoPort=43431, infoSecurePort=0, ipcPort=39331, storageInfo=lv=-57;cid=testClusterID;nsid=1496906999;c=1676318600054), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-13 20:03:22,383 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x71e6f4c87a0f2754: Processing first storage report for DS-94942b12-0d0c-4042-a141-ae0b73e0decb from datanode dc2dda6d-cf86-4de4-8687-b125e63263c8 2023-02-13 20:03:22,383 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x71e6f4c87a0f2754: from storage DS-94942b12-0d0c-4042-a141-ae0b73e0decb node DatanodeRegistration(127.0.0.1:40177, datanodeUuid=dc2dda6d-cf86-4de4-8687-b125e63263c8, infoPort=39321, infoSecurePort=0, ipcPort=37397, storageInfo=lv=-57;cid=testClusterID;nsid=1496906999;c=1676318600054), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:22,383 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe5ee7aec2eaaf3f6: Processing first storage report for DS-ca330ad6-dfe7-4280-b571-681a73fa7a03 from datanode 7df4099f-e054-42f3-9b42-4e78fdb49ccd 2023-02-13 20:03:22,384 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe5ee7aec2eaaf3f6: from storage DS-ca330ad6-dfe7-4280-b571-681a73fa7a03 node DatanodeRegistration(127.0.0.1:33039, datanodeUuid=7df4099f-e054-42f3-9b42-4e78fdb49ccd, infoPort=43431, infoSecurePort=0, ipcPort=39331, storageInfo=lv=-57;cid=testClusterID;nsid=1496906999;c=1676318600054), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:22,489 DEBUG [Listener at localhost/39331] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366 2023-02-13 20:03:22,576 INFO [Listener at localhost/39331] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/cluster_7c69506b-0957-c1d7-85bd-d8f120766d1b/zookeeper_0, clientPort=60561, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/cluster_7c69506b-0957-c1d7-85bd-d8f120766d1b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/cluster_7c69506b-0957-c1d7-85bd-d8f120766d1b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 20:03:22,600 INFO [Listener at localhost/39331] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60561 2023-02-13 20:03:22,612 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:22,614 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:23,288 INFO [Listener at localhost/39331] util.FSUtils(479): Created version file at hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96 with version=8 2023-02-13 20:03:23,288 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:23,290 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:23,293 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/hbase-staging 2023-02-13 20:03:23,616 INFO [Listener at localhost/39331] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-13 20:03:24,070 INFO [Listener at localhost/39331] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:03:24,105 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:24,106 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:24,106 INFO [Listener at localhost/39331] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:03:24,106 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:24,106 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:03:24,304 INFO [Listener at localhost/39331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:03:24,387 DEBUG [Listener at localhost/39331] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-13 20:03:24,482 INFO [Listener at localhost/39331] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39241 2023-02-13 20:03:24,492 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:24,494 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:24,516 INFO [Listener at localhost/39331] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39241 connecting to ZooKeeper ensemble=127.0.0.1:60561 2023-02-13 20:03:24,562 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:392410x0, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:03:24,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39241-0x1004f47defe0000 connected 2023-02-13 20:03:24,595 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:24,596 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:24,599 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:03:24,607 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39241 2023-02-13 20:03:24,607 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39241 2023-02-13 20:03:24,608 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39241 2023-02-13 20:03:24,609 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39241 2023-02-13 20:03:24,610 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39241 2023-02-13 20:03:24,616 INFO [Listener at localhost/39331] master.HMaster(439): hbase.rootdir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96, hbase.cluster.distributed=false 2023-02-13 20:03:24,685 INFO [Listener at localhost/39331] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:03:24,685 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:24,685 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:24,685 INFO [Listener at localhost/39331] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:03:24,686 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:24,686 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:03:24,691 INFO [Listener at localhost/39331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:03:24,693 INFO [Listener at localhost/39331] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44139 2023-02-13 20:03:24,696 INFO [Listener at localhost/39331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:03:24,703 DEBUG [Listener at localhost/39331] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:24,704 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:24,706 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:24,708 INFO [Listener at localhost/39331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44139 connecting to ZooKeeper ensemble=127.0.0.1:60561 2023-02-13 20:03:24,712 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:441390x0, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:03:24,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44139-0x1004f47defe0001 connected 2023-02-13 20:03:24,713 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:24,714 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:24,715 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:03:24,716 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44139 2023-02-13 20:03:24,716 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44139 2023-02-13 20:03:24,716 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44139 2023-02-13 20:03:24,717 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44139 2023-02-13 20:03:24,717 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44139 2023-02-13 20:03:24,730 INFO [Listener at localhost/39331] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:03:24,730 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:24,731 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:24,731 INFO [Listener at localhost/39331] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:03:24,732 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:24,732 INFO [Listener at localhost/39331] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:03:24,732 INFO [Listener at localhost/39331] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:03:24,734 INFO [Listener at localhost/39331] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41557 2023-02-13 20:03:24,735 INFO [Listener at localhost/39331] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:03:24,736 DEBUG [Listener at localhost/39331] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:24,736 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:24,739 INFO [Listener at localhost/39331] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:24,741 INFO [Listener at localhost/39331] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41557 connecting to ZooKeeper ensemble=127.0.0.1:60561 2023-02-13 20:03:24,747 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:415570x0, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:03:24,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41557-0x1004f47defe0002 connected 2023-02-13 20:03:24,748 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:24,749 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:24,749 DEBUG [Listener at localhost/39331] zookeeper.ZKUtil(164): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:03:24,750 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41557 2023-02-13 20:03:24,752 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41557 2023-02-13 20:03:24,753 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41557 2023-02-13 20:03:24,754 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41557 2023-02-13 20:03:24,754 DEBUG [Listener at localhost/39331] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41557 2023-02-13 20:03:24,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39241,1676318603456 2023-02-13 20:03:24,766 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:03:24,767 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39241,1676318603456 2023-02-13 20:03:24,788 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:24,788 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:24,788 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:24,788 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:24,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:03:24,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39241,1676318603456 from backup master directory 2023-02-13 20:03:24,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:03:24,794 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39241,1676318603456 2023-02-13 20:03:24,794 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:03:24,795 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:03:24,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,39241,1676318603456 2023-02-13 20:03:24,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-13 20:03:24,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-13 20:03:24,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/hbase.id with ID: b2659fb6-c827-4dfe-9c84-ca184c8b5542 2023-02-13 20:03:24,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:24,940 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:24,997 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x662a701b to 127.0.0.1:60561 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:25,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40bb9859, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:25,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:25,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 20:03:25,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-13 20:03:25,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-13 20:03:25,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 20:03:25,088 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 20:03:25,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:25,130 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/MasterData/data/master/store-tmp 2023-02-13 20:03:25,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:25,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:03:25,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:25,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:25,171 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:03:25,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:25,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:25,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318605170Disabling compacts and flushes for region at 1676318605171 (+1 ms)Disabling writes for close at 1676318605172 (+1 ms)Writing region close event to WAL at 1676318605172Closed at 1676318605172 2023-02-13 20:03:25,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/MasterData/WALs/jenkins-hbase4.apache.org,39241,1676318603456 2023-02-13 20:03:25,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39241%2C1676318603456, suffix=, logDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/MasterData/WALs/jenkins-hbase4.apache.org,39241,1676318603456, archiveDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/MasterData/oldWALs, maxLogs=10 2023-02-13 20:03:25,262 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-b1e05c86-4e1c-4e62-8def-982669cac8f4,DISK] 2023-02-13 20:03:25,262 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33039,DS-7abc0ed0-f07d-482a-bde8-a3a180d66d6b,DISK] 2023-02-13 20:03:25,270 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-13 20:03:25,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/MasterData/WALs/jenkins-hbase4.apache.org,39241,1676318603456/jenkins-hbase4.apache.org%2C39241%2C1676318603456.1676318605212 2023-02-13 20:03:25,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33039,DS-7abc0ed0-f07d-482a-bde8-a3a180d66d6b,DISK], DatanodeInfoWithStorage[127.0.0.1:40177,DS-b1e05c86-4e1c-4e62-8def-982669cac8f4,DISK]] 2023-02-13 20:03:25,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:03:25,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:25,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:25,339 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:25,400 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:25,407 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 20:03:25,446 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 20:03:25,460 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:25,466 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:25,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:25,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:25,485 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:25,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58989126, jitterRate=-0.12099352478981018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:03:25,486 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676318605369Initializing all the Stores at 1676318605371 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318605371Cleaning up temporary data from old regions at 1676318605473 (+102 ms)Cleaning up detritus from prior splits at 1676318605474 (+1 ms)Region opened successfully at 1676318605486 (+12 ms) 2023-02-13 20:03:25,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 20:03:25,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 20:03:25,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 20:03:25,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 20:03:25,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-13 20:03:25,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-02-13 20:03:25,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 20:03:25,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 20:03:25,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 20:03:25,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 20:03:25,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 20:03:25,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 20:03:25,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 20:03:25,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 20:03:25,637 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:25,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 20:03:25,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 20:03:25,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 20:03:25,657 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:25,657 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:25,657 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:25,657 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:25,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,39241,1676318603456, sessionid=0x1004f47defe0000, setting cluster-up flag (Was=false) 2023-02-13 20:03:25,679 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:25,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 20:03:25,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39241,1676318603456 2023-02-13 20:03:25,697 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:25,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 20:03:25,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39241,1676318603456 2023-02-13 20:03:25,707 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.hbase-snapshot/.tmp 2023-02-13 20:03:25,760 INFO [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(952): ClusterId : b2659fb6-c827-4dfe-9c84-ca184c8b5542 2023-02-13 20:03:25,763 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(952): ClusterId : b2659fb6-c827-4dfe-9c84-ca184c8b5542 2023-02-13 20:03:25,767 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:03:25,767 DEBUG [RS:0;jenkins-hbase4:44139] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:03:25,774 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:03:25,774 DEBUG [RS:0;jenkins-hbase4:44139] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:03:25,775 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:03:25,775 DEBUG [RS:0;jenkins-hbase4:44139] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:03:25,778 DEBUG [RS:0;jenkins-hbase4:44139] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:03:25,778 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:03:25,779 DEBUG [RS:0;jenkins-hbase4:44139] zookeeper.ReadOnlyZKClient(139): Connect 0x3c0fab1e to 127.0.0.1:60561 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:25,779 DEBUG [RS:1;jenkins-hbase4:41557] zookeeper.ReadOnlyZKClient(139): Connect 0x3bbfea63 to 127.0.0.1:60561 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:25,793 DEBUG [RS:0;jenkins-hbase4:44139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69484db7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:25,793 DEBUG [RS:1;jenkins-hbase4:41557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19a98328, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:25,794 DEBUG [RS:0;jenkins-hbase4:44139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6032f363, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:03:25,794 DEBUG [RS:1;jenkins-hbase4:41557] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2df231a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:03:25,821 DEBUG [RS:0;jenkins-hbase4:44139] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44139 2023-02-13 20:03:25,821 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41557 2023-02-13 20:03:25,826 INFO [RS:1;jenkins-hbase4:41557] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:03:25,826 INFO [RS:0;jenkins-hbase4:44139] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:03:25,827 INFO [RS:1;jenkins-hbase4:41557] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:03:25,827 INFO [RS:0;jenkins-hbase4:44139] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:03:25,827 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:03:25,827 DEBUG [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:03:25,830 INFO [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39241,1676318603456 with isa=jenkins-hbase4.apache.org/172.31.14.131:44139, startcode=1676318604684 2023-02-13 20:03:25,830 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39241,1676318603456 with isa=jenkins-hbase4.apache.org/172.31.14.131:41557, startcode=1676318604730 2023-02-13 20:03:25,849 DEBUG [RS:0;jenkins-hbase4:44139] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:03:25,849 DEBUG [RS:1;jenkins-hbase4:41557] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:03:25,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 20:03:25,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:25,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:25,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:25,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:25,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 20:03:25,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:25,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:03:25,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:25,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676318635888 2023-02-13 20:03:25,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 20:03:25,893 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:03:25,894 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 20:03:25,899 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:25,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 20:03:25,908 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52377, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:03:25,908 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41431, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:03:25,910 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 20:03:25,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 20:03:25,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 20:03:25,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 20:03:25,912 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:25,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 20:03:25,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 20:03:25,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39241] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 20:03:25,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 20:03:25,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 20:03:25,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 20:03:25,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 20:03:25,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318605924,5,FailOnTimeoutGroup] 2023-02-13 20:03:25,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318605924,5,FailOnTimeoutGroup] 2023-02-13 20:03:25,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:25,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 20:03:25,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:25,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:25,953 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(2829): Master is not running yet 2023-02-13 20:03:25,953 DEBUG [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(2829): Master is not running yet 2023-02-13 20:03:25,954 WARN [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-13 20:03:25,954 WARN [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-13 20:03:26,346 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:26,347 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:26,348 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96 2023-02-13 20:03:26,365 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:26,368 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:03:26,371 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/info 2023-02-13 20:03:26,372 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:03:26,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:26,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:03:26,376 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:03:26,377 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:03:26,378 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:26,378 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:03:26,380 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/table 2023-02-13 20:03:26,381 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:03:26,381 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:26,383 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740 2023-02-13 20:03:26,384 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740 2023-02-13 20:03:26,389 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:03:26,391 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:03:26,395 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:26,396 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73646172, jitterRate=0.09741348028182983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:03:26,396 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676318606365Initializing all the Stores at 1676318606367 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318606367Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318606367Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318606367Cleaning up temporary data from old regions at 1676318606386 (+19 ms)Cleaning up detritus from prior splits at 1676318606387 (+1 ms)Region opened successfully at 1676318606396 (+9 ms) 2023-02-13 20:03:26,396 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:03:26,396 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:03:26,396 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:03:26,396 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:03:26,396 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:03:26,397 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:03:26,398 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318606396Disabling compacts and flushes for region at 1676318606396Disabling writes for close at 1676318606396Writing region close event to WAL at 1676318606397 (+1 ms)Closed at 1676318606397 2023-02-13 20:03:26,403 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:03:26,403 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 20:03:26,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 20:03:26,424 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 20:03:26,427 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 20:03:26,577 WARN [jenkins-hbase4:39241] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-13 20:03:26,955 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39241,1676318603456 with isa=jenkins-hbase4.apache.org/172.31.14.131:41557, startcode=1676318604730 2023-02-13 20:03:26,955 INFO [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39241,1676318603456 with isa=jenkins-hbase4.apache.org/172.31.14.131:44139, startcode=1676318604684 2023-02-13 20:03:26,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:26,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39241] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:26,969 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96 2023-02-13 20:03:26,969 DEBUG [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96 2023-02-13 20:03:26,969 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36203 2023-02-13 20:03:26,969 DEBUG [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36203 2023-02-13 20:03:26,969 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:03:26,969 DEBUG [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:03:26,981 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:26,981 DEBUG [RS:0;jenkins-hbase4:44139] zookeeper.ZKUtil(162): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:26,981 WARN [RS:0;jenkins-hbase4:44139] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:03:26,981 INFO [RS:0;jenkins-hbase4:44139] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:26,982 DEBUG [RS:1;jenkins-hbase4:41557] zookeeper.ZKUtil(162): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:26,982 DEBUG [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/WALs/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:26,982 WARN [RS:1;jenkins-hbase4:41557] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:03:26,982 INFO [RS:1;jenkins-hbase4:41557] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:26,983 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/WALs/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:26,985 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41557,1676318604730] 2023-02-13 20:03:26,985 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44139,1676318604684] 2023-02-13 20:03:26,993 DEBUG [RS:0;jenkins-hbase4:44139] zookeeper.ZKUtil(162): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:26,993 DEBUG [RS:1;jenkins-hbase4:41557] zookeeper.ZKUtil(162): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:26,993 DEBUG [RS:0;jenkins-hbase4:44139] zookeeper.ZKUtil(162): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:26,993 DEBUG [RS:1;jenkins-hbase4:41557] zookeeper.ZKUtil(162): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:27,004 DEBUG [RS:0;jenkins-hbase4:44139] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:03:27,004 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:03:27,014 INFO [RS:0;jenkins-hbase4:44139] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:03:27,014 INFO [RS:1;jenkins-hbase4:41557] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:03:27,034 INFO [RS:0;jenkins-hbase4:44139] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:03:27,034 INFO [RS:1;jenkins-hbase4:41557] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:03:27,038 INFO [RS:0;jenkins-hbase4:44139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:03:27,038 INFO [RS:1;jenkins-hbase4:41557] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:03:27,039 INFO [RS:0;jenkins-hbase4:44139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,039 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,040 INFO [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:03:27,040 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:03:27,048 INFO [RS:0;jenkins-hbase4:44139] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,048 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,048 DEBUG [RS:0;jenkins-hbase4:44139] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,048 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,049 DEBUG [RS:0;jenkins-hbase4:44139] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,049 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,049 DEBUG [RS:0;jenkins-hbase4:44139] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,049 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,049 DEBUG [RS:0;jenkins-hbase4:44139] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,049 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,049 DEBUG [RS:0;jenkins-hbase4:44139] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,050 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,050 DEBUG [RS:0;jenkins-hbase4:44139] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:03:27,050 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:03:27,050 DEBUG [RS:0;jenkins-hbase4:44139] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,050 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,050 DEBUG [RS:0;jenkins-hbase4:44139] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,050 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,050 DEBUG [RS:0;jenkins-hbase4:44139] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,050 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,050 DEBUG [RS:0;jenkins-hbase4:44139] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,051 DEBUG [RS:1;jenkins-hbase4:41557] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:27,052 INFO [RS:0;jenkins-hbase4:44139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,052 INFO [RS:0;jenkins-hbase4:44139] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,052 INFO [RS:0;jenkins-hbase4:44139] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,052 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,053 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,053 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,070 INFO [RS:0;jenkins-hbase4:44139] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:03:27,070 INFO [RS:1;jenkins-hbase4:41557] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:03:27,074 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41557,1676318604730-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,074 INFO [RS:0;jenkins-hbase4:44139] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44139,1676318604684-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,079 DEBUG [jenkins-hbase4:39241] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 20:03:27,085 DEBUG [jenkins-hbase4:39241] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:03:27,092 DEBUG [jenkins-hbase4:39241] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:03:27,093 DEBUG [jenkins-hbase4:39241] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:03:27,093 DEBUG [jenkins-hbase4:39241] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:03:27,096 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44139,1676318604684, state=OPENING 2023-02-13 20:03:27,097 INFO [RS:0;jenkins-hbase4:44139] regionserver.Replication(203): jenkins-hbase4.apache.org,44139,1676318604684 started 2023-02-13 20:03:27,097 INFO [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44139,1676318604684, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44139, sessionid=0x1004f47defe0001 2023-02-13 20:03:27,100 INFO [RS:1;jenkins-hbase4:41557] regionserver.Replication(203): jenkins-hbase4.apache.org,41557,1676318604730 started 2023-02-13 20:03:27,100 DEBUG [RS:0;jenkins-hbase4:44139] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:03:27,100 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41557,1676318604730, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41557, sessionid=0x1004f47defe0002 2023-02-13 20:03:27,100 DEBUG [RS:0;jenkins-hbase4:44139] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:27,100 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:03:27,100 DEBUG [RS:0;jenkins-hbase4:44139] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44139,1676318604684' 2023-02-13 20:03:27,100 DEBUG [RS:1;jenkins-hbase4:41557] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:27,101 DEBUG [RS:0;jenkins-hbase4:44139] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:27,101 DEBUG [RS:1;jenkins-hbase4:41557] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41557,1676318604730' 2023-02-13 20:03:27,101 DEBUG [RS:1;jenkins-hbase4:41557] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:27,102 DEBUG [RS:0;jenkins-hbase4:44139] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:27,102 DEBUG [RS:1;jenkins-hbase4:41557] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:27,103 DEBUG [RS:0;jenkins-hbase4:44139] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:03:27,103 DEBUG [RS:0;jenkins-hbase4:44139] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:03:27,103 DEBUG [RS:0;jenkins-hbase4:44139] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:27,103 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:03:27,103 DEBUG [RS:0;jenkins-hbase4:44139] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44139,1676318604684' 2023-02-13 20:03:27,103 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:03:27,103 DEBUG [RS:0;jenkins-hbase4:44139] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:27,103 DEBUG [RS:1;jenkins-hbase4:41557] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:27,104 DEBUG [RS:1;jenkins-hbase4:41557] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41557,1676318604730' 2023-02-13 20:03:27,104 DEBUG [RS:1;jenkins-hbase4:41557] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:27,104 DEBUG [RS:0;jenkins-hbase4:44139] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:27,104 DEBUG [RS:1;jenkins-hbase4:41557] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:27,105 DEBUG [RS:0;jenkins-hbase4:44139] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:03:27,105 INFO [RS:0;jenkins-hbase4:44139] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:03:27,105 INFO [RS:0;jenkins-hbase4:44139] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:03:27,105 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 20:03:27,105 DEBUG [RS:1;jenkins-hbase4:41557] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:03:27,106 INFO [RS:1;jenkins-hbase4:41557] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:03:27,106 INFO [RS:1;jenkins-hbase4:41557] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:03:27,107 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:27,108 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:03:27,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44139,1676318604684}] 2023-02-13 20:03:27,297 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:27,299 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 20:03:27,303 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34512, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 20:03:27,316 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 20:03:27,316 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:27,320 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44139%2C1676318604684.meta, suffix=.meta, logDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/WALs/jenkins-hbase4.apache.org,44139,1676318604684, archiveDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/oldWALs, maxLogs=32 2023-02-13 20:03:27,344 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-b1e05c86-4e1c-4e62-8def-982669cac8f4,DISK] 2023-02-13 20:03:27,344 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33039,DS-7abc0ed0-f07d-482a-bde8-a3a180d66d6b,DISK] 2023-02-13 20:03:27,348 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/WALs/jenkins-hbase4.apache.org,44139,1676318604684/jenkins-hbase4.apache.org%2C44139%2C1676318604684.meta.1676318607324.meta 2023-02-13 20:03:27,348 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40177,DS-b1e05c86-4e1c-4e62-8def-982669cac8f4,DISK], DatanodeInfoWithStorage[127.0.0.1:33039,DS-7abc0ed0-f07d-482a-bde8-a3a180d66d6b,DISK]] 2023-02-13 20:03:27,348 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:03:27,350 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 20:03:27,371 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 20:03:27,376 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 20:03:27,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 20:03:27,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:27,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 20:03:27,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 20:03:27,384 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:03:27,386 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/info 2023-02-13 20:03:27,386 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/info 2023-02-13 20:03:27,387 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:03:27,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:27,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:03:27,390 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:03:27,390 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:03:27,391 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:03:27,391 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:27,391 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:03:27,393 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/table 2023-02-13 20:03:27,393 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/table 2023-02-13 20:03:27,393 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:03:27,394 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:27,396 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740 2023-02-13 20:03:27,399 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740 2023-02-13 20:03:27,402 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:03:27,405 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:03:27,407 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70436245, jitterRate=0.04958184063434601}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:03:27,407 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676318607382Writing region info on filesystem at 1676318607382Initializing all the Stores at 1676318607384 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318607384Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318607384Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318607384Cleaning up temporary data from old regions at 1676318607400 (+16 ms)Cleaning up detritus from prior splits at 1676318607401 (+1 ms)Running coprocessor post-open hooks at 1676318607407 (+6 ms)Region opened successfully at 1676318607407 2023-02-13 20:03:27,417 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676318607289 2023-02-13 20:03:27,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 20:03:27,442 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 20:03:27,442 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44139,1676318604684, state=OPEN 2023-02-13 20:03:27,445 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 20:03:27,446 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:03:27,450 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 20:03:27,450 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44139,1676318604684 in 333 msec 2023-02-13 20:03:27,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 20:03:27,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.0390 sec 2023-02-13 20:03:27,461 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.6680 sec 2023-02-13 20:03:27,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676318604781, completionTime=-1 2023-02-13 20:03:27,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 20:03:27,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 20:03:27,528 DEBUG [hconnection-0x26208f51-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:27,531 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34528, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:27,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 20:03:27,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676318667550 2023-02-13 20:03:27,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676318727550 2023-02-13 20:03:27,550 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 88 msec 2023-02-13 20:03:27,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39241,1676318603456-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39241,1676318603456-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39241,1676318603456-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39241, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:27,585 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 20:03:27,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 20:03:27,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:27,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 20:03:27,606 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:03:27,610 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:03:27,637 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/hbase/namespace/cd72c71a44411ee025dccd57b28ace46 2023-02-13 20:03:27,641 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/hbase/namespace/cd72c71a44411ee025dccd57b28ace46 empty. 2023-02-13 20:03:27,642 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/hbase/namespace/cd72c71a44411ee025dccd57b28ace46 2023-02-13 20:03:27,642 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 20:03:27,670 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:27,673 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => cd72c71a44411ee025dccd57b28ace46, NAME => 'hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp 2023-02-13 20:03:27,694 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:27,695 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing cd72c71a44411ee025dccd57b28ace46, disabling compactions & flushes 2023-02-13 20:03:27,695 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. 2023-02-13 20:03:27,695 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. 2023-02-13 20:03:27,695 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. after waiting 0 ms 2023-02-13 20:03:27,695 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. 2023-02-13 20:03:27,696 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. 2023-02-13 20:03:27,696 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for cd72c71a44411ee025dccd57b28ace46: Waiting for close lock at 1676318607695Disabling compacts and flushes for region at 1676318607695Disabling writes for close at 1676318607695Writing region close event to WAL at 1676318607695Closed at 1676318607695 2023-02-13 20:03:27,701 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:03:27,716 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318607704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318607704"}]},"ts":"1676318607704"} 2023-02-13 20:03:27,751 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 20:03:27,753 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:03:27,758 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318607753"}]},"ts":"1676318607753"} 2023-02-13 20:03:27,763 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 20:03:27,767 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:03:27,768 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:03:27,768 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:03:27,768 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:03:27,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cd72c71a44411ee025dccd57b28ace46, ASSIGN}] 2023-02-13 20:03:27,774 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cd72c71a44411ee025dccd57b28ace46, ASSIGN 2023-02-13 20:03:27,776 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=cd72c71a44411ee025dccd57b28ace46, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41557,1676318604730; forceNewPlan=false, retain=false 2023-02-13 20:03:27,928 INFO [jenkins-hbase4:39241] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 20:03:27,929 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cd72c71a44411ee025dccd57b28ace46, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:27,930 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318607929"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318607929"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318607929"}]},"ts":"1676318607929"} 2023-02-13 20:03:27,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure cd72c71a44411ee025dccd57b28ace46, server=jenkins-hbase4.apache.org,41557,1676318604730}] 2023-02-13 20:03:28,089 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:28,089 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 20:03:28,092 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40996, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 20:03:28,099 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. 2023-02-13 20:03:28,102 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41557%2C1676318604730, suffix=, logDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/WALs/jenkins-hbase4.apache.org,41557,1676318604730, archiveDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/oldWALs, maxLogs=32 2023-02-13 20:03:28,119 INFO [RS:0;jenkins-hbase4:44139] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44139%2C1676318604684, suffix=, logDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/WALs/jenkins-hbase4.apache.org,44139,1676318604684, archiveDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/oldWALs, maxLogs=32 2023-02-13 20:03:28,123 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33039,DS-7abc0ed0-f07d-482a-bde8-a3a180d66d6b,DISK] 2023-02-13 20:03:28,124 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-b1e05c86-4e1c-4e62-8def-982669cac8f4,DISK] 2023-02-13 20:03:28,128 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/WALs/jenkins-hbase4.apache.org,41557,1676318604730/jenkins-hbase4.apache.org%2C41557%2C1676318604730.1676318608103 2023-02-13 20:03:28,128 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33039,DS-7abc0ed0-f07d-482a-bde8-a3a180d66d6b,DISK], DatanodeInfoWithStorage[127.0.0.1:40177,DS-b1e05c86-4e1c-4e62-8def-982669cac8f4,DISK]] 2023-02-13 20:03:28,129 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cd72c71a44411ee025dccd57b28ace46, NAME => 'hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:03:28,129 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace cd72c71a44411ee025dccd57b28ace46 2023-02-13 20:03:28,129 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:28,130 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cd72c71a44411ee025dccd57b28ace46 2023-02-13 20:03:28,130 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cd72c71a44411ee025dccd57b28ace46 2023-02-13 20:03:28,132 INFO [StoreOpener-cd72c71a44411ee025dccd57b28ace46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cd72c71a44411ee025dccd57b28ace46 2023-02-13 20:03:28,134 DEBUG [StoreOpener-cd72c71a44411ee025dccd57b28ace46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/namespace/cd72c71a44411ee025dccd57b28ace46/info 2023-02-13 20:03:28,134 DEBUG [StoreOpener-cd72c71a44411ee025dccd57b28ace46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/namespace/cd72c71a44411ee025dccd57b28ace46/info 2023-02-13 20:03:28,135 INFO [StoreOpener-cd72c71a44411ee025dccd57b28ace46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd72c71a44411ee025dccd57b28ace46 columnFamilyName info 2023-02-13 20:03:28,136 INFO [StoreOpener-cd72c71a44411ee025dccd57b28ace46-1] regionserver.HStore(310): Store=cd72c71a44411ee025dccd57b28ace46/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:28,139 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/namespace/cd72c71a44411ee025dccd57b28ace46 2023-02-13 20:03:28,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/namespace/cd72c71a44411ee025dccd57b28ace46 2023-02-13 20:03:28,144 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40177,DS-b1e05c86-4e1c-4e62-8def-982669cac8f4,DISK] 2023-02-13 20:03:28,148 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cd72c71a44411ee025dccd57b28ace46 2023-02-13 20:03:28,155 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33039,DS-7abc0ed0-f07d-482a-bde8-a3a180d66d6b,DISK] 2023-02-13 20:03:28,157 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/namespace/cd72c71a44411ee025dccd57b28ace46/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:28,158 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cd72c71a44411ee025dccd57b28ace46; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59261047, jitterRate=-0.11694158613681793}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:03:28,158 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cd72c71a44411ee025dccd57b28ace46: Running coprocessor pre-open hook at 1676318608130Writing region info on filesystem at 1676318608130Initializing all the Stores at 1676318608131 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318608131Cleaning up temporary data from old regions at 1676318608144 (+13 ms)Cleaning up detritus from prior splits at 1676318608144Running coprocessor post-open hooks at 1676318608158 (+14 ms)Region opened successfully at 1676318608158 2023-02-13 20:03:28,165 INFO [RS:0;jenkins-hbase4:44139] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/WALs/jenkins-hbase4.apache.org,44139,1676318604684/jenkins-hbase4.apache.org%2C44139%2C1676318604684.1676318608121 2023-02-13 20:03:28,165 DEBUG [RS:0;jenkins-hbase4:44139] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40177,DS-b1e05c86-4e1c-4e62-8def-982669cac8f4,DISK], DatanodeInfoWithStorage[127.0.0.1:33039,DS-7abc0ed0-f07d-482a-bde8-a3a180d66d6b,DISK]] 2023-02-13 20:03:28,165 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46., pid=6, masterSystemTime=1676318608089 2023-02-13 20:03:28,171 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. 2023-02-13 20:03:28,171 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. 2023-02-13 20:03:28,172 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cd72c71a44411ee025dccd57b28ace46, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:28,173 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318608172"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318608172"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318608172"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318608172"}]},"ts":"1676318608172"} 2023-02-13 20:03:28,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 20:03:28,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure cd72c71a44411ee025dccd57b28ace46, server=jenkins-hbase4.apache.org,41557,1676318604730 in 242 msec 2023-02-13 20:03:28,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 20:03:28,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=cd72c71a44411ee025dccd57b28ace46, ASSIGN in 410 msec 2023-02-13 20:03:28,186 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:03:28,187 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318608186"}]},"ts":"1676318608186"} 2023-02-13 20:03:28,189 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 20:03:28,193 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:03:28,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 598 msec 2023-02-13 20:03:28,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 20:03:28,208 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:03:28,208 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:28,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:28,233 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41000, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:28,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 20:03:28,267 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:03:28,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 46 msec 2023-02-13 20:03:28,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 20:03:28,304 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:03:28,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-02-13 20:03:28,324 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 20:03:28,328 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 20:03:28,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.533sec 2023-02-13 20:03:28,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 20:03:28,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 20:03:28,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 20:03:28,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39241,1676318603456-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 20:03:28,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39241,1676318603456-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 20:03:28,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 20:03:28,365 DEBUG [Listener at localhost/39331] zookeeper.ReadOnlyZKClient(139): Connect 0x0ac00ad9 to 127.0.0.1:60561 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:28,370 DEBUG [Listener at localhost/39331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35291aba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:28,418 DEBUG [hconnection-0x3128be3e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:28,429 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34538, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:28,443 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39241,1676318603456 2023-02-13 20:03:28,443 DEBUG [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 20:03:28,455 DEBUG [Listener at localhost/39331] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 20:03:28,460 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40484, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 20:03:28,468 INFO [Listener at localhost/39331] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 20:03:28,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 20:03:28,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 20:03:28,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:40484 deadline: 1676318668473, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 20:03:28,477 INFO [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 20:03:28,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:28,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 20:03:28,502 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:03:28,504 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:03:28,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 20:03:28,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:28,560 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:28,569 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f empty. 2023-02-13 20:03:28,588 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:28,596 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:28,596 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:28,596 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:28,605 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5 empty. 2023-02-13 20:03:28,605 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:28,607 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d empty. 2023-02-13 20:03:28,607 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:28,607 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:28,608 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143 empty. 2023-02-13 20:03:28,608 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e empty. 2023-02-13 20:03:28,607 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:28,607 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:28,608 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:28,608 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3 empty. 2023-02-13 20:03:28,608 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:28,608 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:28,609 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1 empty. 2023-02-13 20:03:28,609 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688 empty. 2023-02-13 20:03:28,609 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:28,609 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:28,609 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:28,609 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83 empty. 2023-02-13 20:03:28,610 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:28,610 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:28,610 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:28,610 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd empty. 2023-02-13 20:03:28,611 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:28,611 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 20:03:28,633 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:28,636 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => c019ce0ac50892e0e02cf665fd9a0143, NAME => 'testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp 2023-02-13 20:03:28,636 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8d2a9d00d13ed0d8081a57d0c816058f, NAME => 'testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp 2023-02-13 20:03:28,636 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1ff46d3cf47a857c973f635fc585aaa5, NAME => 'testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp 2023-02-13 20:03:28,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:28,702 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:28,703 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 8d2a9d00d13ed0d8081a57d0c816058f, disabling compactions & flushes 2023-02-13 20:03:28,703 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:28,703 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:28,704 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. after waiting 0 ms 2023-02-13 20:03:28,704 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:28,704 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:28,707 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 8d2a9d00d13ed0d8081a57d0c816058f: Waiting for close lock at 1676318608703Disabling compacts and flushes for region at 1676318608703Disabling writes for close at 1676318608704 (+1 ms)Writing region close event to WAL at 1676318608704Closed at 1676318608704 2023-02-13 20:03:28,709 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => a3484f1c6de9066fea0153c5227abc4d, NAME => 'testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp 2023-02-13 20:03:28,710 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:28,710 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing c019ce0ac50892e0e02cf665fd9a0143, disabling compactions & flushes 2023-02-13 20:03:28,710 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:28,710 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:28,710 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. after waiting 0 ms 2023-02-13 20:03:28,710 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:28,710 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:28,710 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for c019ce0ac50892e0e02cf665fd9a0143: Waiting for close lock at 1676318608710Disabling compacts and flushes for region at 1676318608710Disabling writes for close at 1676318608710Writing region close event to WAL at 1676318608710Closed at 1676318608710 2023-02-13 20:03:28,711 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:28,711 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => aa4d100449bf1790cfc36baed2d7590e, NAME => 'testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp 2023-02-13 20:03:28,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 1ff46d3cf47a857c973f635fc585aaa5, disabling compactions & flushes 2023-02-13 20:03:28,712 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:28,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:28,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. after waiting 0 ms 2023-02-13 20:03:28,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:28,712 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:28,712 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 1ff46d3cf47a857c973f635fc585aaa5: Waiting for close lock at 1676318608711Disabling compacts and flushes for region at 1676318608711Disabling writes for close at 1676318608712 (+1 ms)Writing region close event to WAL at 1676318608712Closed at 1676318608712 2023-02-13 20:03:28,714 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 01673b1d44e4ba19d57c597c9c938de1, NAME => 'testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp 2023-02-13 20:03:28,737 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:28,739 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing a3484f1c6de9066fea0153c5227abc4d, disabling compactions & flushes 2023-02-13 20:03:28,739 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:28,739 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:28,739 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing aa4d100449bf1790cfc36baed2d7590e, disabling compactions & flushes 2023-02-13 20:03:28,739 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:28,740 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:28,740 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. after waiting 0 ms 2023-02-13 20:03:28,740 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:28,740 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:28,740 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. after waiting 0 ms 2023-02-13 20:03:28,740 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:28,740 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:28,740 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for a3484f1c6de9066fea0153c5227abc4d: Waiting for close lock at 1676318608738Disabling compacts and flushes for region at 1676318608738Disabling writes for close at 1676318608740 (+2 ms)Writing region close event to WAL at 1676318608740Closed at 1676318608740 2023-02-13 20:03:28,740 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:28,740 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for aa4d100449bf1790cfc36baed2d7590e: Waiting for close lock at 1676318608739Disabling compacts and flushes for region at 1676318608739Disabling writes for close at 1676318608740 (+1 ms)Writing region close event to WAL at 1676318608740Closed at 1676318608740 2023-02-13 20:03:28,741 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => bd2aba78ec49b2dd0a3179c4fdffb688, NAME => 'testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp 2023-02-13 20:03:28,741 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 40e615ba77a14f152f66739cced6b4f3, NAME => 'testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp 2023-02-13 20:03:28,741 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:28,745 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 01673b1d44e4ba19d57c597c9c938de1, disabling compactions & flushes 2023-02-13 20:03:28,745 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:28,745 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:28,745 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. after waiting 0 ms 2023-02-13 20:03:28,745 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:28,745 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:28,745 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 01673b1d44e4ba19d57c597c9c938de1: Waiting for close lock at 1676318608745Disabling compacts and flushes for region at 1676318608745Disabling writes for close at 1676318608745Writing region close event to WAL at 1676318608745Closed at 1676318608745 2023-02-13 20:03:28,746 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5eb2493284fd88bd0910d9c16859ca83, NAME => 'testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp 2023-02-13 20:03:28,768 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:28,769 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing bd2aba78ec49b2dd0a3179c4fdffb688, disabling compactions & flushes 2023-02-13 20:03:28,769 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:28,769 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:28,769 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. after waiting 0 ms 2023-02-13 20:03:28,769 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:28,769 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:28,769 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for bd2aba78ec49b2dd0a3179c4fdffb688: Waiting for close lock at 1676318608769Disabling compacts and flushes for region at 1676318608769Disabling writes for close at 1676318608769Writing region close event to WAL at 1676318608769Closed at 1676318608769 2023-02-13 20:03:28,770 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0038ac322ee5c7e7ad5ddc9e194eb8bd, NAME => 'testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp 2023-02-13 20:03:28,770 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:28,771 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 40e615ba77a14f152f66739cced6b4f3, disabling compactions & flushes 2023-02-13 20:03:28,771 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:28,771 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:28,771 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. after waiting 0 ms 2023-02-13 20:03:28,772 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:28,772 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:28,772 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 40e615ba77a14f152f66739cced6b4f3: Waiting for close lock at 1676318608771Disabling compacts and flushes for region at 1676318608771Disabling writes for close at 1676318608772 (+1 ms)Writing region close event to WAL at 1676318608772Closed at 1676318608772 2023-02-13 20:03:28,772 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:28,773 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 5eb2493284fd88bd0910d9c16859ca83, disabling compactions & flushes 2023-02-13 20:03:28,773 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:28,773 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:28,773 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. after waiting 0 ms 2023-02-13 20:03:28,773 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:28,773 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:28,774 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 5eb2493284fd88bd0910d9c16859ca83: Waiting for close lock at 1676318608773Disabling compacts and flushes for region at 1676318608773Disabling writes for close at 1676318608773Writing region close event to WAL at 1676318608773Closed at 1676318608773 2023-02-13 20:03:28,785 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:28,785 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 0038ac322ee5c7e7ad5ddc9e194eb8bd, disabling compactions & flushes 2023-02-13 20:03:28,785 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:28,785 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:28,785 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. after waiting 0 ms 2023-02-13 20:03:28,785 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:28,785 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:28,785 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 0038ac322ee5c7e7ad5ddc9e194eb8bd: Waiting for close lock at 1676318608785Disabling compacts and flushes for region at 1676318608785Disabling writes for close at 1676318608785Writing region close event to WAL at 1676318608785Closed at 1676318608785 2023-02-13 20:03:28,790 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:03:28,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318608791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318608791"}]},"ts":"1676318608791"} 2023-02-13 20:03:28,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318608791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318608791"}]},"ts":"1676318608791"} 2023-02-13 20:03:28,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318608791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318608791"}]},"ts":"1676318608791"} 2023-02-13 20:03:28,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318608791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318608791"}]},"ts":"1676318608791"} 2023-02-13 20:03:28,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318608791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318608791"}]},"ts":"1676318608791"} 2023-02-13 20:03:28,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318608791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318608791"}]},"ts":"1676318608791"} 2023-02-13 20:03:28,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318608791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318608791"}]},"ts":"1676318608791"} 2023-02-13 20:03:28,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318608791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318608791"}]},"ts":"1676318608791"} 2023-02-13 20:03:28,793 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318608791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318608791"}]},"ts":"1676318608791"} 2023-02-13 20:03:28,793 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318608791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318608791"}]},"ts":"1676318608791"} 2023-02-13 20:03:28,838 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 20:03:28,840 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:03:28,840 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318608840"}]},"ts":"1676318608840"} 2023-02-13 20:03:28,843 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 20:03:28,848 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:03:28,859 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:03:28,859 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:03:28,859 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:03:28,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8d2a9d00d13ed0d8081a57d0c816058f, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1ff46d3cf47a857c973f635fc585aaa5, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c019ce0ac50892e0e02cf665fd9a0143, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a3484f1c6de9066fea0153c5227abc4d, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=aa4d100449bf1790cfc36baed2d7590e, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=01673b1d44e4ba19d57c597c9c938de1, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bd2aba78ec49b2dd0a3179c4fdffb688, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=40e615ba77a14f152f66739cced6b4f3, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5eb2493284fd88bd0910d9c16859ca83, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0038ac322ee5c7e7ad5ddc9e194eb8bd, ASSIGN}] 2023-02-13 20:03:28,864 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1ff46d3cf47a857c973f635fc585aaa5, ASSIGN 2023-02-13 20:03:28,864 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c019ce0ac50892e0e02cf665fd9a0143, ASSIGN 2023-02-13 20:03:28,864 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8d2a9d00d13ed0d8081a57d0c816058f, ASSIGN 2023-02-13 20:03:28,865 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a3484f1c6de9066fea0153c5227abc4d, ASSIGN 2023-02-13 20:03:28,866 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1ff46d3cf47a857c973f635fc585aaa5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41557,1676318604730; forceNewPlan=false, retain=false 2023-02-13 20:03:28,866 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c019ce0ac50892e0e02cf665fd9a0143, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44139,1676318604684; forceNewPlan=false, retain=false 2023-02-13 20:03:28,866 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8d2a9d00d13ed0d8081a57d0c816058f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41557,1676318604730; forceNewPlan=false, retain=false 2023-02-13 20:03:28,866 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a3484f1c6de9066fea0153c5227abc4d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44139,1676318604684; forceNewPlan=false, retain=false 2023-02-13 20:03:28,867 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0038ac322ee5c7e7ad5ddc9e194eb8bd, ASSIGN 2023-02-13 20:03:28,868 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5eb2493284fd88bd0910d9c16859ca83, ASSIGN 2023-02-13 20:03:28,868 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bd2aba78ec49b2dd0a3179c4fdffb688, ASSIGN 2023-02-13 20:03:28,868 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=40e615ba77a14f152f66739cced6b4f3, ASSIGN 2023-02-13 20:03:28,868 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=01673b1d44e4ba19d57c597c9c938de1, ASSIGN 2023-02-13 20:03:28,869 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0038ac322ee5c7e7ad5ddc9e194eb8bd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44139,1676318604684; forceNewPlan=false, retain=false 2023-02-13 20:03:28,869 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5eb2493284fd88bd0910d9c16859ca83, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44139,1676318604684; forceNewPlan=false, retain=false 2023-02-13 20:03:28,869 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bd2aba78ec49b2dd0a3179c4fdffb688, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41557,1676318604730; forceNewPlan=false, retain=false 2023-02-13 20:03:28,869 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=40e615ba77a14f152f66739cced6b4f3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41557,1676318604730; forceNewPlan=false, retain=false 2023-02-13 20:03:28,869 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=01673b1d44e4ba19d57c597c9c938de1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44139,1676318604684; forceNewPlan=false, retain=false 2023-02-13 20:03:28,870 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=aa4d100449bf1790cfc36baed2d7590e, ASSIGN 2023-02-13 20:03:28,871 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=aa4d100449bf1790cfc36baed2d7590e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41557,1676318604730; forceNewPlan=false, retain=false 2023-02-13 20:03:28,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:29,016 INFO [jenkins-hbase4:39241] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 20:03:29,020 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a3484f1c6de9066fea0153c5227abc4d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:29,020 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=0038ac322ee5c7e7ad5ddc9e194eb8bd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:29,020 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c019ce0ac50892e0e02cf665fd9a0143, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:29,020 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318609020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318609020"}]},"ts":"1676318609020"} 2023-02-13 20:03:29,020 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=01673b1d44e4ba19d57c597c9c938de1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:29,020 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318609020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318609020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318609020"}]},"ts":"1676318609020"} 2023-02-13 20:03:29,021 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318609020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318609020"}]},"ts":"1676318609020"} 2023-02-13 20:03:29,021 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318609020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318609020"}]},"ts":"1676318609020"} 2023-02-13 20:03:29,020 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=5eb2493284fd88bd0910d9c16859ca83, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:29,021 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318609020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318609020"}]},"ts":"1676318609020"} 2023-02-13 20:03:29,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure a3484f1c6de9066fea0153c5227abc4d, server=jenkins-hbase4.apache.org,44139,1676318604684}] 2023-02-13 20:03:29,025 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=20, state=RUNNABLE; OpenRegionProcedure 0038ac322ee5c7e7ad5ddc9e194eb8bd, server=jenkins-hbase4.apache.org,44139,1676318604684}] 2023-02-13 20:03:29,028 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=13, state=RUNNABLE; OpenRegionProcedure c019ce0ac50892e0e02cf665fd9a0143, server=jenkins-hbase4.apache.org,44139,1676318604684}] 2023-02-13 20:03:29,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=16, state=RUNNABLE; OpenRegionProcedure 01673b1d44e4ba19d57c597c9c938de1, server=jenkins-hbase4.apache.org,44139,1676318604684}] 2023-02-13 20:03:29,031 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=aa4d100449bf1790cfc36baed2d7590e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:29,031 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609031"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318609031"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318609031"}]},"ts":"1676318609031"} 2023-02-13 20:03:29,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure 5eb2493284fd88bd0910d9c16859ca83, server=jenkins-hbase4.apache.org,44139,1676318604684}] 2023-02-13 20:03:29,034 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=8d2a9d00d13ed0d8081a57d0c816058f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:29,034 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318609034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318609034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318609034"}]},"ts":"1676318609034"} 2023-02-13 20:03:29,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=15, state=RUNNABLE; OpenRegionProcedure aa4d100449bf1790cfc36baed2d7590e, server=jenkins-hbase4.apache.org,41557,1676318604730}] 2023-02-13 20:03:29,038 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=11, state=RUNNABLE; OpenRegionProcedure 8d2a9d00d13ed0d8081a57d0c816058f, server=jenkins-hbase4.apache.org,41557,1676318604730}] 2023-02-13 20:03:29,038 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=1ff46d3cf47a857c973f635fc585aaa5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:29,039 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609038"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318609038"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318609038"}]},"ts":"1676318609038"} 2023-02-13 20:03:29,038 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=40e615ba77a14f152f66739cced6b4f3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:29,039 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609038"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318609038"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318609038"}]},"ts":"1676318609038"} 2023-02-13 20:03:29,040 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=bd2aba78ec49b2dd0a3179c4fdffb688, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:29,041 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609040"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318609040"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318609040"}]},"ts":"1676318609040"} 2023-02-13 20:03:29,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure 1ff46d3cf47a857c973f635fc585aaa5, server=jenkins-hbase4.apache.org,41557,1676318604730}] 2023-02-13 20:03:29,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure 40e615ba77a14f152f66739cced6b4f3, server=jenkins-hbase4.apache.org,41557,1676318604730}] 2023-02-13 20:03:29,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=17, state=RUNNABLE; OpenRegionProcedure bd2aba78ec49b2dd0a3179c4fdffb688, server=jenkins-hbase4.apache.org,41557,1676318604730}] 2023-02-13 20:03:29,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:29,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a3484f1c6de9066fea0153c5227abc4d, NAME => 'testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 20:03:29,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:29,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:29,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:29,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:29,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:29,187 INFO [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:29,192 DEBUG [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1 2023-02-13 20:03:29,192 DEBUG [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1 2023-02-13 20:03:29,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:29,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aa4d100449bf1790cfc36baed2d7590e, NAME => 'testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 20:03:29,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:29,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:29,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:29,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:29,194 INFO [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3484f1c6de9066fea0153c5227abc4d columnFamilyName f1 2023-02-13 20:03:29,195 INFO [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] regionserver.HStore(310): Store=a3484f1c6de9066fea0153c5227abc4d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,195 INFO [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:29,196 INFO [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:29,198 DEBUG [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2 2023-02-13 20:03:29,198 DEBUG [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2 2023-02-13 20:03:29,198 DEBUG [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1 2023-02-13 20:03:29,198 DEBUG [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1 2023-02-13 20:03:29,199 INFO [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa4d100449bf1790cfc36baed2d7590e columnFamilyName f1 2023-02-13 20:03:29,199 INFO [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3484f1c6de9066fea0153c5227abc4d columnFamilyName f2 2023-02-13 20:03:29,200 INFO [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] regionserver.HStore(310): Store=aa4d100449bf1790cfc36baed2d7590e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,200 INFO [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:29,200 INFO [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] regionserver.HStore(310): Store=a3484f1c6de9066fea0153c5227abc4d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:29,205 DEBUG [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2 2023-02-13 20:03:29,205 DEBUG [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2 2023-02-13 20:03:29,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:29,205 INFO [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa4d100449bf1790cfc36baed2d7590e columnFamilyName f2 2023-02-13 20:03:29,206 INFO [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] regionserver.HStore(310): Store=aa4d100449bf1790cfc36baed2d7590e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:29,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:29,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:29,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:29,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:29,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:29,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:29,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:29,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a3484f1c6de9066fea0153c5227abc4d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70158334, jitterRate=0.04544064402580261}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:29,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a3484f1c6de9066fea0153c5227abc4d: Running coprocessor pre-open hook at 1676318609185Writing region info on filesystem at 1676318609185Initializing all the Stores at 1676318609187 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609187Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609187Cleaning up temporary data from old regions at 1676318609206 (+19 ms)Cleaning up detritus from prior splits at 1676318609207 (+1 ms)Running coprocessor post-open hooks at 1676318609226 (+19 ms)Region opened successfully at 1676318609226 2023-02-13 20:03:29,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened aa4d100449bf1790cfc36baed2d7590e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71156815, jitterRate=0.060319170355796814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:29,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for aa4d100449bf1790cfc36baed2d7590e: Running coprocessor pre-open hook at 1676318609194Writing region info on filesystem at 1676318609194Initializing all the Stores at 1676318609195 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609195Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609195Cleaning up temporary data from old regions at 1676318609210 (+15 ms)Cleaning up detritus from prior splits at 1676318609210Running coprocessor post-open hooks at 1676318609227 (+17 ms)Region opened successfully at 1676318609227 2023-02-13 20:03:29,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d., pid=21, masterSystemTime=1676318609177 2023-02-13 20:03:29,228 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e., pid=26, masterSystemTime=1676318609188 2023-02-13 20:03:29,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:29,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:29,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:29,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bd2aba78ec49b2dd0a3179c4fdffb688, NAME => 'testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 20:03:29,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:29,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:29,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:29,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:29,233 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=aa4d100449bf1790cfc36baed2d7590e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:29,233 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609233"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318609233"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318609233"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318609233"}]},"ts":"1676318609233"} 2023-02-13 20:03:29,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:29,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:29,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:29,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0038ac322ee5c7e7ad5ddc9e194eb8bd, NAME => 'testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 20:03:29,235 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a3484f1c6de9066fea0153c5227abc4d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:29,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:29,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:29,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:29,236 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609235"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318609235"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318609235"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318609235"}]},"ts":"1676318609235"} 2023-02-13 20:03:29,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:29,240 INFO [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:29,241 INFO [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:29,242 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=15 2023-02-13 20:03:29,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=15, state=SUCCESS; OpenRegionProcedure aa4d100449bf1790cfc36baed2d7590e, server=jenkins-hbase4.apache.org,41557,1676318604730 in 203 msec 2023-02-13 20:03:29,243 DEBUG [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd/f1 2023-02-13 20:03:29,244 DEBUG [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd/f1 2023-02-13 20:03:29,244 DEBUG [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1 2023-02-13 20:03:29,244 DEBUG [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1 2023-02-13 20:03:29,244 INFO [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0038ac322ee5c7e7ad5ddc9e194eb8bd columnFamilyName f1 2023-02-13 20:03:29,244 INFO [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd2aba78ec49b2dd0a3179c4fdffb688 columnFamilyName f1 2023-02-13 20:03:29,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-13 20:03:29,246 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure a3484f1c6de9066fea0153c5227abc4d, server=jenkins-hbase4.apache.org,44139,1676318604684 in 215 msec 2023-02-13 20:03:29,246 INFO [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] regionserver.HStore(310): Store=bd2aba78ec49b2dd0a3179c4fdffb688/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,246 INFO [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:29,247 INFO [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] regionserver.HStore(310): Store=0038ac322ee5c7e7ad5ddc9e194eb8bd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=aa4d100449bf1790cfc36baed2d7590e, ASSIGN in 383 msec 2023-02-13 20:03:29,247 INFO [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:29,249 DEBUG [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2 2023-02-13 20:03:29,249 DEBUG [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2 2023-02-13 20:03:29,249 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a3484f1c6de9066fea0153c5227abc4d, ASSIGN in 385 msec 2023-02-13 20:03:29,249 INFO [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd2aba78ec49b2dd0a3179c4fdffb688 columnFamilyName f2 2023-02-13 20:03:29,250 DEBUG [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd/f2 2023-02-13 20:03:29,250 DEBUG [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd/f2 2023-02-13 20:03:29,250 INFO [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] regionserver.HStore(310): Store=bd2aba78ec49b2dd0a3179c4fdffb688/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,252 INFO [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0038ac322ee5c7e7ad5ddc9e194eb8bd columnFamilyName f2 2023-02-13 20:03:29,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:29,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:29,254 INFO [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] regionserver.HStore(310): Store=0038ac322ee5c7e7ad5ddc9e194eb8bd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:29,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:29,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:29,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:29,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:29,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:29,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:29,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:29,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bd2aba78ec49b2dd0a3179c4fdffb688; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60626771, jitterRate=-0.09659071266651154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:29,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bd2aba78ec49b2dd0a3179c4fdffb688: Running coprocessor pre-open hook at 1676318609233Writing region info on filesystem at 1676318609233Initializing all the Stores at 1676318609240 (+7 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609240Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609240Cleaning up temporary data from old regions at 1676318609255 (+15 ms)Cleaning up detritus from prior splits at 1676318609256 (+1 ms)Running coprocessor post-open hooks at 1676318609280 (+24 ms)Region opened successfully at 1676318609280 2023-02-13 20:03:29,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0038ac322ee5c7e7ad5ddc9e194eb8bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75181142, jitterRate=0.12028631567955017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:29,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0038ac322ee5c7e7ad5ddc9e194eb8bd: Running coprocessor pre-open hook at 1676318609236Writing region info on filesystem at 1676318609236Initializing all the Stores at 1676318609237 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609237Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609238 (+1 ms)Cleaning up temporary data from old regions at 1676318609265 (+27 ms)Cleaning up detritus from prior splits at 1676318609267 (+2 ms)Running coprocessor post-open hooks at 1676318609281 (+14 ms)Region opened successfully at 1676318609281 2023-02-13 20:03:29,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd., pid=22, masterSystemTime=1676318609177 2023-02-13 20:03:29,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688., pid=30, masterSystemTime=1676318609188 2023-02-13 20:03:29,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:29,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:29,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:29,286 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=bd2aba78ec49b2dd0a3179c4fdffb688, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:29,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 40e615ba77a14f152f66739cced6b4f3, NAME => 'testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 20:03:29,286 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609286"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318609286"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318609286"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318609286"}]},"ts":"1676318609286"} 2023-02-13 20:03:29,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:29,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:29,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:29,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:29,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:29,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:29,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:29,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c019ce0ac50892e0e02cf665fd9a0143, NAME => 'testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 20:03:29,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:29,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:29,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:29,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:29,290 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=0038ac322ee5c7e7ad5ddc9e194eb8bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:29,290 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318609289"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318609289"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318609289"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318609289"}]},"ts":"1676318609289"} 2023-02-13 20:03:29,291 INFO [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:29,291 INFO [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:29,294 DEBUG [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1 2023-02-13 20:03:29,294 DEBUG [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1 2023-02-13 20:03:29,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=17 2023-02-13 20:03:29,294 DEBUG [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1 2023-02-13 20:03:29,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=17, state=SUCCESS; OpenRegionProcedure bd2aba78ec49b2dd0a3179c4fdffb688, server=jenkins-hbase4.apache.org,41557,1676318604730 in 243 msec 2023-02-13 20:03:29,294 DEBUG [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1 2023-02-13 20:03:29,295 INFO [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c019ce0ac50892e0e02cf665fd9a0143 columnFamilyName f1 2023-02-13 20:03:29,295 INFO [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40e615ba77a14f152f66739cced6b4f3 columnFamilyName f1 2023-02-13 20:03:29,296 INFO [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] regionserver.HStore(310): Store=40e615ba77a14f152f66739cced6b4f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=20 2023-02-13 20:03:29,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bd2aba78ec49b2dd0a3179c4fdffb688, ASSIGN in 434 msec 2023-02-13 20:03:29,296 INFO [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:29,296 INFO [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] regionserver.HStore(310): Store=c019ce0ac50892e0e02cf665fd9a0143/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,297 INFO [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:29,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=20, state=SUCCESS; OpenRegionProcedure 0038ac322ee5c7e7ad5ddc9e194eb8bd, server=jenkins-hbase4.apache.org,44139,1676318604684 in 268 msec 2023-02-13 20:03:29,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0038ac322ee5c7e7ad5ddc9e194eb8bd, ASSIGN in 436 msec 2023-02-13 20:03:29,299 DEBUG [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2 2023-02-13 20:03:29,299 DEBUG [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2 2023-02-13 20:03:29,299 INFO [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40e615ba77a14f152f66739cced6b4f3 columnFamilyName f2 2023-02-13 20:03:29,299 DEBUG [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2 2023-02-13 20:03:29,299 DEBUG [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2 2023-02-13 20:03:29,300 INFO [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c019ce0ac50892e0e02cf665fd9a0143 columnFamilyName f2 2023-02-13 20:03:29,300 INFO [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] regionserver.HStore(310): Store=40e615ba77a14f152f66739cced6b4f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,301 INFO [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] regionserver.HStore(310): Store=c019ce0ac50892e0e02cf665fd9a0143/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:29,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:29,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:29,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:29,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:29,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:29,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:29,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:29,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:29,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:29,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 40e615ba77a14f152f66739cced6b4f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64530372, jitterRate=-0.03842252492904663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:29,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 40e615ba77a14f152f66739cced6b4f3: Running coprocessor pre-open hook at 1676318609287Writing region info on filesystem at 1676318609287Initializing all the Stores at 1676318609290 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609290Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609290Cleaning up temporary data from old regions at 1676318609304 (+14 ms)Cleaning up detritus from prior splits at 1676318609305 (+1 ms)Running coprocessor post-open hooks at 1676318609312 (+7 ms)Region opened successfully at 1676318609312 2023-02-13 20:03:29,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c019ce0ac50892e0e02cf665fd9a0143; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64118706, jitterRate=-0.04455682635307312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:29,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c019ce0ac50892e0e02cf665fd9a0143: Running coprocessor pre-open hook at 1676318609289Writing region info on filesystem at 1676318609289Initializing all the Stores at 1676318609290 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609290Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609291 (+1 ms)Cleaning up temporary data from old regions at 1676318609305 (+14 ms)Cleaning up detritus from prior splits at 1676318609305Running coprocessor post-open hooks at 1676318609313 (+8 ms)Region opened successfully at 1676318609313 2023-02-13 20:03:29,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3., pid=29, masterSystemTime=1676318609188 2023-02-13 20:03:29,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143., pid=23, masterSystemTime=1676318609177 2023-02-13 20:03:29,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:29,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:29,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:29,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1ff46d3cf47a857c973f635fc585aaa5, NAME => 'testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 20:03:29,318 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=40e615ba77a14f152f66739cced6b4f3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:29,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:29,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:29,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:29,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:29,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:29,318 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609317"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318609317"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318609317"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318609317"}]},"ts":"1676318609317"} 2023-02-13 20:03:29,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:29,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 01673b1d44e4ba19d57c597c9c938de1, NAME => 'testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 20:03:29,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:29,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:29,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:29,319 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c019ce0ac50892e0e02cf665fd9a0143, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:29,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:29,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:29,319 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609319"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318609319"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318609319"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318609319"}]},"ts":"1676318609319"} 2023-02-13 20:03:29,324 INFO [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:29,324 INFO [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:29,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-13 20:03:29,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure 40e615ba77a14f152f66739cced6b4f3, server=jenkins-hbase4.apache.org,41557,1676318604730 in 276 msec 2023-02-13 20:03:29,326 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=13 2023-02-13 20:03:29,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=13, state=SUCCESS; OpenRegionProcedure c019ce0ac50892e0e02cf665fd9a0143, server=jenkins-hbase4.apache.org,44139,1676318604684 in 295 msec 2023-02-13 20:03:29,327 DEBUG [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1 2023-02-13 20:03:29,327 DEBUG [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1 2023-02-13 20:03:29,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=40e615ba77a14f152f66739cced6b4f3, ASSIGN in 465 msec 2023-02-13 20:03:29,328 INFO [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01673b1d44e4ba19d57c597c9c938de1 columnFamilyName f1 2023-02-13 20:03:29,329 INFO [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] regionserver.HStore(310): Store=01673b1d44e4ba19d57c597c9c938de1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,329 INFO [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:29,331 DEBUG [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2 2023-02-13 20:03:29,331 DEBUG [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2 2023-02-13 20:03:29,332 INFO [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01673b1d44e4ba19d57c597c9c938de1 columnFamilyName f2 2023-02-13 20:03:29,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c019ce0ac50892e0e02cf665fd9a0143, ASSIGN in 467 msec 2023-02-13 20:03:29,333 INFO [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] regionserver.HStore(310): Store=01673b1d44e4ba19d57c597c9c938de1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,333 DEBUG [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1 2023-02-13 20:03:29,334 DEBUG [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1 2023-02-13 20:03:29,334 INFO [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ff46d3cf47a857c973f635fc585aaa5 columnFamilyName f1 2023-02-13 20:03:29,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:29,335 INFO [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] regionserver.HStore(310): Store=1ff46d3cf47a857c973f635fc585aaa5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,335 INFO [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:29,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:29,337 DEBUG [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2 2023-02-13 20:03:29,337 DEBUG [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2 2023-02-13 20:03:29,338 INFO [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ff46d3cf47a857c973f635fc585aaa5 columnFamilyName f2 2023-02-13 20:03:29,339 INFO [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] regionserver.HStore(310): Store=1ff46d3cf47a857c973f635fc585aaa5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:29,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:29,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:29,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:29,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:29,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:29,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 01673b1d44e4ba19d57c597c9c938de1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63140774, jitterRate=-0.059129148721694946}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:29,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 01673b1d44e4ba19d57c597c9c938de1: Running coprocessor pre-open hook at 1676318609319Writing region info on filesystem at 1676318609319Initializing all the Stores at 1676318609321 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609321Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609324 (+3 ms)Cleaning up temporary data from old regions at 1676318609337 (+13 ms)Cleaning up detritus from prior splits at 1676318609337Running coprocessor post-open hooks at 1676318609346 (+9 ms)Region opened successfully at 1676318609346 2023-02-13 20:03:29,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:29,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1., pid=24, masterSystemTime=1676318609177 2023-02-13 20:03:29,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:29,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:29,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:29,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5eb2493284fd88bd0910d9c16859ca83, NAME => 'testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 20:03:29,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:29,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:29,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:29,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:29,352 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=01673b1d44e4ba19d57c597c9c938de1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:29,352 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609352"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318609352"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318609352"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318609352"}]},"ts":"1676318609352"} 2023-02-13 20:03:29,353 INFO [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:29,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:29,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1ff46d3cf47a857c973f635fc585aaa5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73906850, jitterRate=0.10129788517951965}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:29,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1ff46d3cf47a857c973f635fc585aaa5: Running coprocessor pre-open hook at 1676318609319Writing region info on filesystem at 1676318609319Initializing all the Stores at 1676318609321 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609321Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609324 (+3 ms)Cleaning up temporary data from old regions at 1676318609342 (+18 ms)Cleaning up detritus from prior splits at 1676318609343 (+1 ms)Running coprocessor post-open hooks at 1676318609355 (+12 ms)Region opened successfully at 1676318609355 2023-02-13 20:03:29,356 DEBUG [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1 2023-02-13 20:03:29,356 DEBUG [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1 2023-02-13 20:03:29,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5., pid=28, masterSystemTime=1676318609188 2023-02-13 20:03:29,356 INFO [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5eb2493284fd88bd0910d9c16859ca83 columnFamilyName f1 2023-02-13 20:03:29,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=16 2023-02-13 20:03:29,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=16, state=SUCCESS; OpenRegionProcedure 01673b1d44e4ba19d57c597c9c938de1, server=jenkins-hbase4.apache.org,44139,1676318604684 in 325 msec 2023-02-13 20:03:29,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:29,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:29,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:29,359 INFO [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] regionserver.HStore(310): Store=5eb2493284fd88bd0910d9c16859ca83/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8d2a9d00d13ed0d8081a57d0c816058f, NAME => 'testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 20:03:29,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:29,359 INFO [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:29,360 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=1ff46d3cf47a857c973f635fc585aaa5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:29,361 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609360"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318609360"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318609360"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318609360"}]},"ts":"1676318609360"} 2023-02-13 20:03:29,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:29,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:29,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:29,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=01673b1d44e4ba19d57c597c9c938de1, ASSIGN in 498 msec 2023-02-13 20:03:29,364 DEBUG [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2 2023-02-13 20:03:29,364 DEBUG [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2 2023-02-13 20:03:29,365 INFO [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5eb2493284fd88bd0910d9c16859ca83 columnFamilyName f2 2023-02-13 20:03:29,365 INFO [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:29,366 INFO [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] regionserver.HStore(310): Store=5eb2493284fd88bd0910d9c16859ca83/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:29,369 DEBUG [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f/f1 2023-02-13 20:03:29,369 DEBUG [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f/f1 2023-02-13 20:03:29,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:29,369 INFO [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d2a9d00d13ed0d8081a57d0c816058f columnFamilyName f1 2023-02-13 20:03:29,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-13 20:03:29,370 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure 1ff46d3cf47a857c973f635fc585aaa5, server=jenkins-hbase4.apache.org,41557,1676318604730 in 322 msec 2023-02-13 20:03:29,370 INFO [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] regionserver.HStore(310): Store=8d2a9d00d13ed0d8081a57d0c816058f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,371 INFO [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:29,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:29,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1ff46d3cf47a857c973f635fc585aaa5, ASSIGN in 510 msec 2023-02-13 20:03:29,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:29,376 DEBUG [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f/f2 2023-02-13 20:03:29,376 DEBUG [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f/f2 2023-02-13 20:03:29,377 INFO [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d2a9d00d13ed0d8081a57d0c816058f columnFamilyName f2 2023-02-13 20:03:29,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:29,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5eb2493284fd88bd0910d9c16859ca83; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62613505, jitterRate=-0.0669860690832138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:29,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5eb2493284fd88bd0910d9c16859ca83: Running coprocessor pre-open hook at 1676318609352Writing region info on filesystem at 1676318609352Initializing all the Stores at 1676318609353 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609353Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609353Cleaning up temporary data from old regions at 1676318609370 (+17 ms)Cleaning up detritus from prior splits at 1676318609371 (+1 ms)Running coprocessor post-open hooks at 1676318609379 (+8 ms)Region opened successfully at 1676318609379 2023-02-13 20:03:29,380 INFO [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] regionserver.HStore(310): Store=8d2a9d00d13ed0d8081a57d0c816058f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:29,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83., pid=25, masterSystemTime=1676318609177 2023-02-13 20:03:29,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:29,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:29,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:29,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:29,386 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=5eb2493284fd88bd0910d9c16859ca83, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:29,386 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318609386"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318609386"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318609386"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318609386"}]},"ts":"1676318609386"} 2023-02-13 20:03:29,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:29,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:29,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-13 20:03:29,393 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure 5eb2493284fd88bd0910d9c16859ca83, server=jenkins-hbase4.apache.org,44139,1676318604684 in 357 msec 2023-02-13 20:03:29,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:29,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8d2a9d00d13ed0d8081a57d0c816058f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70469282, jitterRate=0.05007413029670715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:29,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8d2a9d00d13ed0d8081a57d0c816058f: Running coprocessor pre-open hook at 1676318609363Writing region info on filesystem at 1676318609363Initializing all the Stores at 1676318609365 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609365Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318609365Cleaning up temporary data from old regions at 1676318609385 (+20 ms)Cleaning up detritus from prior splits at 1676318609386 (+1 ms)Running coprocessor post-open hooks at 1676318609395 (+9 ms)Region opened successfully at 1676318609395 2023-02-13 20:03:29,395 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5eb2493284fd88bd0910d9c16859ca83, ASSIGN in 533 msec 2023-02-13 20:03:29,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f., pid=27, masterSystemTime=1676318609188 2023-02-13 20:03:29,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:29,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:29,400 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=8d2a9d00d13ed0d8081a57d0c816058f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:29,400 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318609400"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318609400"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318609400"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318609400"}]},"ts":"1676318609400"} 2023-02-13 20:03:29,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=11 2023-02-13 20:03:29,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=11, state=SUCCESS; OpenRegionProcedure 8d2a9d00d13ed0d8081a57d0c816058f, server=jenkins-hbase4.apache.org,41557,1676318604730 in 364 msec 2023-02-13 20:03:29,411 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 20:03:29,412 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8d2a9d00d13ed0d8081a57d0c816058f, ASSIGN in 548 msec 2023-02-13 20:03:29,413 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:03:29,413 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318609413"}]},"ts":"1676318609413"} 2023-02-13 20:03:29,415 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 20:03:29,418 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:03:29,422 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 922 msec 2023-02-13 20:03:29,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:29,689 INFO [Listener at localhost/39331] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 20:03:29,689 DEBUG [Listener at localhost/39331] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 20:03:29,691 INFO [Listener at localhost/39331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:03:29,703 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 20:03:29,703 INFO [Listener at localhost/39331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:03:29,704 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 20:03:29,704 INFO [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 20:03:29,830 DEBUG [hconnection-0x3128be3e-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:29,906 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41010, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:29,955 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44139] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:29,956 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41557] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:30,261 INFO [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 20:03:30,266 INFO [Listener at localhost/39331] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 20:03:30,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 20:03:30,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676318610279 (current time:1676318610279). 2023-02-13 20:03:30,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 20:03:30,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] zookeeper.ReadOnlyZKClient(139): Connect 0x248eb475 to 127.0.0.1:60561 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:30,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4542718f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:30,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:30,313 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34548, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:30,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x248eb475 to 127.0.0.1:60561 2023-02-13 20:03:30,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:30,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 20:03:30,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 20:03:30,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 20:03:30,345 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 20:03:30,347 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676319210347 2023-02-13 20:03:30,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 20:03:30,350 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 20:03:30,353 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 20:03:30,353 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 20:03:30,354 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 20:03:30,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 20:03:30,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 21 msec 2023-02-13 20:03:30,364 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 20:03:30,365 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676319210365 2023-02-13 20:03:30,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-13 20:03:30,404 INFO [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-13 20:03:30,404 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:03:30,405 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-13 20:03:30,405 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 20:03:30,419 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:30,419 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 20:03:30,422 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:30,422 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:30,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:30,422 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:30,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:30,423 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 20:03:30,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 20:03:30,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-13 20:03:30,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 20:03:30,425 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 20:03:30,423 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:30,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:30,428 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:30,428 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:03:30,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-13 20:03:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-13 20:03:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 20:03:30,428 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 20:03:30,428 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-13 20:03:30,428 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:03:30,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-13 20:03:30,429 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 20:03:30,429 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-13 20:03:30,429 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44139,1676318604684' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-13 20:03:30,429 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-13 20:03:30,429 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:03:30,429 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 20:03:30,429 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-13 20:03:30,429 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41557,1676318604730' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-13 20:03:30,431 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 20:03:30,431 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:30,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:30,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:30,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:30,432 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:30,432 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 20:03:30,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:30,432 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:30,432 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 20:03:30,433 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 20:03:30,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:30,433 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:30,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 20:03:30,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:30,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:30,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:30,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44139,1676318604684' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-13 20:03:30,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@198dcd92[Count = 1] remaining members to acquire global barrier 2023-02-13 20:03:30,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:30,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:30,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:30,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:30,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:30,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 20:03:30,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:30,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:30,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:30,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41557,1676318604730' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-13 20:03:30,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@198dcd92[Count = 0] remaining members to acquire global barrier 2023-02-13 20:03:30,439 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 20:03:30,439 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 20:03:30,440 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 20:03:30,440 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 20:03:30,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 20:03:30,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 20:03:30,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 20:03:30,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 20:03:30,441 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 20:03:30,441 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:30,441 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 20:03:30,441 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:30,441 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:03:30,442 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:30,442 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:30,442 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:30,443 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:30,443 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 20:03:30,443 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. started... 2023-02-13 20:03:30,443 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. started... 2023-02-13 20:03:30,443 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. started... 2023-02-13 20:03:30,443 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. started... 2023-02-13 20:03:30,443 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:30,443 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:30,443 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. started... 2023-02-13 20:03:30,443 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 20:03:30,443 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 20:03:30,443 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. started... 2023-02-13 20:03:30,443 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 20:03:30,445 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bd2aba78ec49b2dd0a3179c4fdffb688 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:30,445 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c019ce0ac50892e0e02cf665fd9a0143 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:30,445 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 40e615ba77a14f152f66739cced6b4f3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:30,445 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] regionserver.HRegion(2744): Flushing aa4d100449bf1790cfc36baed2d7590e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:30,446 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 01673b1d44e4ba19d57c597c9c938de1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:30,447 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0038ac322ee5c7e7ad5ddc9e194eb8bd: 2023-02-13 20:03:30,448 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:30,453 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:30,454 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:30,459 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 20:03:30,459 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 20:03:30,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 20:03:30,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:03:30,464 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 20:03:30,481 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. completed. 2023-02-13 20:03:30,481 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:30,482 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:30,482 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 20:03:30,482 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. started... 2023-02-13 20:03:30,483 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5eb2493284fd88bd0910d9c16859ca83 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 20:03:30,655 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/.tmp/f1/27a9c26d12d54d9f90787e6cf5fa3385 2023-02-13 20:03:30,664 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:30,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 20:03:30,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:03:30,667 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 20:03:30,680 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/.tmp/f1/1fe67ddc32d84b80add4b59bfa17c5d9 2023-02-13 20:03:30,700 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/.tmp/f1/59381f230b8b4c7a8fd16eba1322f770 2023-02-13 20:03:30,796 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/.tmp/f2/ee0d8e776f904b5c9cce7482af4e51ec 2023-02-13 20:03:30,813 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/.tmp/f1/59381f230b8b4c7a8fd16eba1322f770 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1/59381f230b8b4c7a8fd16eba1322f770 2023-02-13 20:03:30,814 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/.tmp/f2/059eb03071bf450eb92cb2f6724594cf 2023-02-13 20:03:30,817 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/.tmp/f2/74c9e7e9ca3d45adbb63c5757e235af8 2023-02-13 20:03:30,825 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/.tmp/f1/27a9c26d12d54d9f90787e6cf5fa3385 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1/27a9c26d12d54d9f90787e6cf5fa3385 2023-02-13 20:03:30,826 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1/59381f230b8b4c7a8fd16eba1322f770, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:30,828 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/.tmp/f1/1fe67ddc32d84b80add4b59bfa17c5d9 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1/1fe67ddc32d84b80add4b59bfa17c5d9 2023-02-13 20:03:30,829 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/.tmp/f2/ee0d8e776f904b5c9cce7482af4e51ec as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2/ee0d8e776f904b5c9cce7482af4e51ec 2023-02-13 20:03:30,837 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1/27a9c26d12d54d9f90787e6cf5fa3385, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 20:03:30,839 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/.tmp/f2/059eb03071bf450eb92cb2f6724594cf as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2/059eb03071bf450eb92cb2f6724594cf 2023-02-13 20:03:30,839 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1/1fe67ddc32d84b80add4b59bfa17c5d9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:30,841 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/.tmp/f2/74c9e7e9ca3d45adbb63c5757e235af8 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2/74c9e7e9ca3d45adbb63c5757e235af8 2023-02-13 20:03:30,841 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2/ee0d8e776f904b5c9cce7482af4e51ec, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:30,843 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 01673b1d44e4ba19d57c597c9c938de1 in 397ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:30,845 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-13 20:03:30,847 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 01673b1d44e4ba19d57c597c9c938de1: 2023-02-13 20:03:30,847 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:30,847 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:30,847 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1/59381f230b8b4c7a8fd16eba1322f770] hfiles 2023-02-13 20:03:30,847 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1/59381f230b8b4c7a8fd16eba1322f770 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:30,852 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2/ee0d8e776f904b5c9cce7482af4e51ec] hfiles 2023-02-13 20:03:30,852 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2/ee0d8e776f904b5c9cce7482af4e51ec for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:30,852 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2/74c9e7e9ca3d45adbb63c5757e235af8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:30,854 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 40e615ba77a14f152f66739cced6b4f3 in 409ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:30,856 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 40e615ba77a14f152f66739cced6b4f3: 2023-02-13 20:03:30,857 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:30,857 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:30,857 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1/1fe67ddc32d84b80add4b59bfa17c5d9] hfiles 2023-02-13 20:03:30,857 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1/1fe67ddc32d84b80add4b59bfa17c5d9 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:30,857 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2/74c9e7e9ca3d45adbb63c5757e235af8] hfiles 2023-02-13 20:03:30,857 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2/74c9e7e9ca3d45adbb63c5757e235af8 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:30,862 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2/059eb03071bf450eb92cb2f6724594cf, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 20:03:30,863 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 5eb2493284fd88bd0910d9c16859ca83 in 380ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:30,863 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5eb2493284fd88bd0910d9c16859ca83: 2023-02-13 20:03:30,864 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:30,864 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:30,864 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1/27a9c26d12d54d9f90787e6cf5fa3385] hfiles 2023-02-13 20:03:30,864 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1/27a9c26d12d54d9f90787e6cf5fa3385 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:30,864 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2/059eb03071bf450eb92cb2f6724594cf] hfiles 2023-02-13 20:03:30,864 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2/059eb03071bf450eb92cb2f6724594cf for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:30,901 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. completed. 2023-02-13 20:03:30,901 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:30,901 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 20:03:30,901 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:30,902 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. started... 2023-02-13 20:03:30,902 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 1ff46d3cf47a857c973f635fc585aaa5 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 20:03:30,905 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. completed. 2023-02-13 20:03:30,905 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:30,905 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:30,905 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 20:03:30,905 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. started... 2023-02-13 20:03:30,906 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HRegion(2744): Flushing a3484f1c6de9066fea0153c5227abc4d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:30,909 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. completed. 2023-02-13 20:03:30,909 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:30,909 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 20:03:30,936 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/.tmp/f1/9f327ba82b5940d5a4d11f7b7bb9bfe3 2023-02-13 20:03:30,937 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/.tmp/f1/65b9486249c04a468f33ffda0fa5db15 2023-02-13 20:03:30,967 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:30,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 20:03:30,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:03:30,970 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 20:03:30,973 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/.tmp/f2/9634e0e0807c4270a9a016c4f7183449 2023-02-13 20:03:30,981 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/.tmp/f2/b5d24c3c637a425b97fb271435b7c6e4 2023-02-13 20:03:30,982 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/.tmp/f1/65b9486249c04a468f33ffda0fa5db15 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1/65b9486249c04a468f33ffda0fa5db15 2023-02-13 20:03:30,990 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1/65b9486249c04a468f33ffda0fa5db15, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:30,991 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/.tmp/f1/9f327ba82b5940d5a4d11f7b7bb9bfe3 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1/9f327ba82b5940d5a4d11f7b7bb9bfe3 2023-02-13 20:03:30,991 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/.tmp/f2/9634e0e0807c4270a9a016c4f7183449 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2/9634e0e0807c4270a9a016c4f7183449 2023-02-13 20:03:30,999 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1/9f327ba82b5940d5a4d11f7b7bb9bfe3, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 20:03:31,001 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/.tmp/f2/b5d24c3c637a425b97fb271435b7c6e4 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2/b5d24c3c637a425b97fb271435b7c6e4 2023-02-13 20:03:31,005 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2/9634e0e0807c4270a9a016c4f7183449, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:31,007 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a3484f1c6de9066fea0153c5227abc4d in 101ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:31,007 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a3484f1c6de9066fea0153c5227abc4d: 2023-02-13 20:03:31,007 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,008 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:31,008 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1/65b9486249c04a468f33ffda0fa5db15] hfiles 2023-02-13 20:03:31,008 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1/65b9486249c04a468f33ffda0fa5db15 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,008 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2/9634e0e0807c4270a9a016c4f7183449] hfiles 2023-02-13 20:03:31,008 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2/9634e0e0807c4270a9a016c4f7183449 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,014 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2/b5d24c3c637a425b97fb271435b7c6e4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 20:03:31,015 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 1ff46d3cf47a857c973f635fc585aaa5 in 113ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:31,015 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 1ff46d3cf47a857c973f635fc585aaa5: 2023-02-13 20:03:31,015 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,015 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:31,015 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1/9f327ba82b5940d5a4d11f7b7bb9bfe3] hfiles 2023-02-13 20:03:31,015 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1/9f327ba82b5940d5a4d11f7b7bb9bfe3 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,015 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2/b5d24c3c637a425b97fb271435b7c6e4] hfiles 2023-02-13 20:03:31,015 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2/b5d24c3c637a425b97fb271435b7c6e4 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,039 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. completed. 2023-02-13 20:03:31,039 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:31,039 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 20:03:31,042 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. completed. 2023-02-13 20:03:31,042 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:31,043 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:31,043 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 20:03:31,043 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. started... 2023-02-13 20:03:31,043 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8d2a9d00d13ed0d8081a57d0c816058f: 2023-02-13 20:03:31,044 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,044 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:31,044 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 20:03:31,044 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 20:03:31,057 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. completed. 2023-02-13 20:03:31,057 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:31,057 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 20:03:31,075 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/.tmp/f1/1b722cc4b6c44e48a7bf7be2b7a8f546 2023-02-13 20:03:31,087 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/.tmp/f1/1c0199bf67134ab8b47ccf02c90bba08 2023-02-13 20:03:31,112 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/.tmp/f1/c0ac94a31b28494f9a276c0e04a32f90 2023-02-13 20:03:31,172 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/.tmp/f2/273f1a5311344becbfef1500bb405f83 2023-02-13 20:03:31,176 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/.tmp/f2/570aa99b4b8c4479b6936f156aa72632 2023-02-13 20:03:31,182 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/.tmp/f2/60730c4a9f7948d9aa55253ba8608cc9 2023-02-13 20:03:31,184 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/.tmp/f1/1b722cc4b6c44e48a7bf7be2b7a8f546 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1/1b722cc4b6c44e48a7bf7be2b7a8f546 2023-02-13 20:03:31,186 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/.tmp/f1/1c0199bf67134ab8b47ccf02c90bba08 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1/1c0199bf67134ab8b47ccf02c90bba08 2023-02-13 20:03:31,191 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/.tmp/f1/c0ac94a31b28494f9a276c0e04a32f90 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1/c0ac94a31b28494f9a276c0e04a32f90 2023-02-13 20:03:31,193 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1/1c0199bf67134ab8b47ccf02c90bba08, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:31,194 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1/1b722cc4b6c44e48a7bf7be2b7a8f546, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:31,197 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/.tmp/f2/570aa99b4b8c4479b6936f156aa72632 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2/570aa99b4b8c4479b6936f156aa72632 2023-02-13 20:03:31,198 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/.tmp/f2/273f1a5311344becbfef1500bb405f83 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2/273f1a5311344becbfef1500bb405f83 2023-02-13 20:03:31,216 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1/c0ac94a31b28494f9a276c0e04a32f90, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:31,216 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2/570aa99b4b8c4479b6936f156aa72632, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:31,218 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bd2aba78ec49b2dd0a3179c4fdffb688 in 772ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:31,218 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bd2aba78ec49b2dd0a3179c4fdffb688: 2023-02-13 20:03:31,218 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/.tmp/f2/60730c4a9f7948d9aa55253ba8608cc9 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2/60730c4a9f7948d9aa55253ba8608cc9 2023-02-13 20:03:31,218 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,218 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2/273f1a5311344becbfef1500bb405f83, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:31,218 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:31,218 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1/1c0199bf67134ab8b47ccf02c90bba08] hfiles 2023-02-13 20:03:31,218 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1/1c0199bf67134ab8b47ccf02c90bba08 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,218 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2/570aa99b4b8c4479b6936f156aa72632] hfiles 2023-02-13 20:03:31,218 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2/570aa99b4b8c4479b6936f156aa72632 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,219 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c019ce0ac50892e0e02cf665fd9a0143 in 774ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:31,220 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c019ce0ac50892e0e02cf665fd9a0143: 2023-02-13 20:03:31,220 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,220 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:31,220 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1/1b722cc4b6c44e48a7bf7be2b7a8f546] hfiles 2023-02-13 20:03:31,220 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1/1b722cc4b6c44e48a7bf7be2b7a8f546 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,220 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2/273f1a5311344becbfef1500bb405f83] hfiles 2023-02-13 20:03:31,220 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2/273f1a5311344becbfef1500bb405f83 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,227 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2/60730c4a9f7948d9aa55253ba8608cc9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:31,228 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for aa4d100449bf1790cfc36baed2d7590e in 784ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:31,228 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for aa4d100449bf1790cfc36baed2d7590e: 2023-02-13 20:03:31,228 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,228 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:31,229 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1/c0ac94a31b28494f9a276c0e04a32f90] hfiles 2023-02-13 20:03:31,229 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1/c0ac94a31b28494f9a276c0e04a32f90 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,229 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2/60730c4a9f7948d9aa55253ba8608cc9] hfiles 2023-02-13 20:03:31,229 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2/60730c4a9f7948d9aa55253ba8608cc9 for snapshot=testWithMapReduceMultiRegion 2023-02-13 20:03:31,242 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. completed. 2023-02-13 20:03:31,242 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:31,242 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 20:03:31,255 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. completed. 2023-02-13 20:03:31,255 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. completed. 2023-02-13 20:03:31,255 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:31,255 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:31,256 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 20:03:31,256 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 20:03:31,256 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 20:03:31,256 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 20:03:31,256 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,256 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,256 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-13 20:03:31,256 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-13 20:03:31,256 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,41557,1676318604730' in zk 2023-02-13 20:03:31,256 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,44139,1676318604684' in zk 2023-02-13 20:03:31,261 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,261 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-13 20:03:31,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:31,261 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:31,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:31,261 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-13 20:03:31,262 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,262 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-13 20:03:31,262 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:31,262 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-13 20:03:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:31,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:31,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 20:03:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:31,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 20:03:31,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,41557,1676318604730': 2023-02-13 20:03:31,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41557,1676318604730' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 20:03:31,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:31,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:31,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:31,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:31,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 20:03:31,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 20:03:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,44139,1676318604684': 2023-02-13 20:03:31,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44139,1676318604684' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 20:03:31,273 INFO [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-13 20:03:31,273 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:03:31,273 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:03:31,273 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-13 20:03:31,273 INFO [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 20:03:31,275 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:31,275 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:31,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:31,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:31,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:31,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:31,276 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:31,275 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:31,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:31,276 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:31,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:31,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:31,276 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:31,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:31,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:31,277 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 20:03:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:31,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 20:03:31,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,279 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:31,280 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 20:03:31,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,296 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,296 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:31,296 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 20:03:31,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:31,296 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:31,296 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:31,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:31,296 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:31,296 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:31,296 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-13 20:03:31,296 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 20:03:31,296 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:31,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:31,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-13 20:03:31,297 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:31,297 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 20:03:31,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:31,297 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,297 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 20:03:31,298 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 20:03:31,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:31,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:31,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 20:03:31,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-13 20:03:31,412 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-13 20:03:31,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 20:03:31,413 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 20:03:31,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676318610351Consolidate snapshot: testWithMapReduceMultiRegion at 1676318611297 (+946 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676318611297Writing data manifest for testWithMapReduceMultiRegion at 1676318611336 (+39 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676318611353 (+17 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676318611412 (+59 ms) 2023-02-13 20:03:31,414 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 20:03:31,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0590 sec 2023-02-13 20:03:31,471 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:31,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 20:03:31,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 20:03:31,474 INFO [Listener at localhost/39331] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 20:03:31,487 INFO [Listener at localhost/39331] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 20:03:31,500 INFO [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 20:03:31,573 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44139] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:31,575 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41557] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:31,754 INFO [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 20:03:31,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 20:03:31,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 20:03:31,781 INFO [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 20:03:31,781 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:03:31,782 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 20:03:31,782 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 20:03:31,783 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:31,783 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:31,859 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:31,859 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:31,859 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:31,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:31,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:31,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:31,860 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:31,860 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:31,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:31,861 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:31,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:31,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:31,861 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:03:31,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:03:31,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:03:31,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:31,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:31,861 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 20:03:31,862 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 20:03:31,864 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 20:03:31,867 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 20:03:31,868 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 20:03:31,868 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:03:31,868 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 20:03:31,868 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 20:03:31,868 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:03:31,869 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 20:03:31,870 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:31,870 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:31,870 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:31,870 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:31,870 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:31,870 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. started... 2023-02-13 20:03:31,870 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. started... 2023-02-13 20:03:31,870 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:31,870 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 20:03:31,870 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. started... 2023-02-13 20:03:31,870 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 20:03:31,871 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 01673b1d44e4ba19d57c597c9c938de1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:31,871 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 40e615ba77a14f152f66739cced6b4f3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:31,870 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 20:03:31,871 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 20:03:31,870 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. started... 2023-02-13 20:03:31,871 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c019ce0ac50892e0e02cf665fd9a0143 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:31,870 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. started... 2023-02-13 20:03:31,872 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bd2aba78ec49b2dd0a3179c4fdffb688 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:31,870 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0038ac322ee5c7e7ad5ddc9e194eb8bd: 2023-02-13 20:03:31,870 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. started... 2023-02-13 20:03:31,873 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:31,873 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:31,873 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing aa4d100449bf1790cfc36baed2d7590e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:31,873 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. started... 2023-02-13 20:03:31,873 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 20:03:31,874 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5eb2493284fd88bd0910d9c16859ca83 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 20:03:31,955 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/.tmp/f1/6c2f8ef242984391b0afbf3c3371c450 2023-02-13 20:03:31,956 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/.tmp/f1/a74f2083ec4d41c0b3ee85dce265cbf3 2023-02-13 20:03:31,958 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/.tmp/f1/4e0fab84fa454539b934c01fd02ab18f 2023-02-13 20:03:31,958 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/.tmp/f1/05a01d5d337a44698001137fb9a20d00 2023-02-13 20:03:31,959 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/.tmp/f1/9e576719cc2d49359eb432a9d0a632f7 2023-02-13 20:03:31,965 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/.tmp/f1/6352d0a5f76042028f64137fb9fc9765 2023-02-13 20:03:32,004 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/.tmp/f2/bf03ea3c163d44dca527f8323d695059 2023-02-13 20:03:32,011 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/.tmp/f1/6c2f8ef242984391b0afbf3c3371c450 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1/6c2f8ef242984391b0afbf3c3371c450 2023-02-13 20:03:32,033 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/.tmp/f2/2b748db97c1c4515a9c427c0b0d43764 2023-02-13 20:03:32,041 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/.tmp/f1/9e576719cc2d49359eb432a9d0a632f7 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1/9e576719cc2d49359eb432a9d0a632f7 2023-02-13 20:03:32,044 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/.tmp/f2/c9af2b2428544fd0b21bfccd9890c44c 2023-02-13 20:03:32,044 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/.tmp/f2/744dcf165ba44dea89de08fe9d973ac5 2023-02-13 20:03:32,050 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1/6c2f8ef242984391b0afbf3c3371c450, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:32,050 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/.tmp/f2/c87201e081b643c7b3a9c6f25ca04d66 2023-02-13 20:03:32,052 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/.tmp/f2/bf03ea3c163d44dca527f8323d695059 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2/bf03ea3c163d44dca527f8323d695059 2023-02-13 20:03:32,053 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1/9e576719cc2d49359eb432a9d0a632f7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:32,059 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/.tmp/f1/a74f2083ec4d41c0b3ee85dce265cbf3 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1/a74f2083ec4d41c0b3ee85dce265cbf3 2023-02-13 20:03:32,061 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/.tmp/f2/2b748db97c1c4515a9c427c0b0d43764 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2/2b748db97c1c4515a9c427c0b0d43764 2023-02-13 20:03:32,061 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/.tmp/f1/05a01d5d337a44698001137fb9a20d00 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1/05a01d5d337a44698001137fb9a20d00 2023-02-13 20:03:32,063 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/.tmp/f2/ef2f9c064cb04729aee83933ec892a9d 2023-02-13 20:03:32,064 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2/bf03ea3c163d44dca527f8323d695059, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:32,066 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 01673b1d44e4ba19d57c597c9c938de1 in 196ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:32,066 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 01673b1d44e4ba19d57c597c9c938de1: 2023-02-13 20:03:32,066 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:32,068 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/.tmp/f1/6352d0a5f76042028f64137fb9fc9765 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1/6352d0a5f76042028f64137fb9fc9765 2023-02-13 20:03:32,068 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 20:03:32,068 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:32,068 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. started... 2023-02-13 20:03:32,068 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a3484f1c6de9066fea0153c5227abc4d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:32,071 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2/2b748db97c1c4515a9c427c0b0d43764, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:32,073 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for aa4d100449bf1790cfc36baed2d7590e in 200ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:32,073 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for aa4d100449bf1790cfc36baed2d7590e: 2023-02-13 20:03:32,073 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:32,074 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1/05a01d5d337a44698001137fb9a20d00, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:32,075 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1/a74f2083ec4d41c0b3ee85dce265cbf3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:32,076 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/.tmp/f2/c87201e081b643c7b3a9c6f25ca04d66 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2/c87201e081b643c7b3a9c6f25ca04d66 2023-02-13 20:03:32,079 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1/6352d0a5f76042028f64137fb9fc9765, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 20:03:32,079 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:32,079 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 20:03:32,079 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. started... 2023-02-13 20:03:32,079 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/.tmp/f2/c9af2b2428544fd0b21bfccd9890c44c as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2/c9af2b2428544fd0b21bfccd9890c44c 2023-02-13 20:03:32,079 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1ff46d3cf47a857c973f635fc585aaa5 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 20:03:32,082 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/.tmp/f2/744dcf165ba44dea89de08fe9d973ac5 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2/744dcf165ba44dea89de08fe9d973ac5 2023-02-13 20:03:32,083 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/.tmp/f1/4e0fab84fa454539b934c01fd02ab18f as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1/4e0fab84fa454539b934c01fd02ab18f 2023-02-13 20:03:32,092 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1/4e0fab84fa454539b934c01fd02ab18f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:32,093 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2/744dcf165ba44dea89de08fe9d973ac5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 20:03:32,094 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 5eb2493284fd88bd0910d9c16859ca83 in 220ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:32,094 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5eb2493284fd88bd0910d9c16859ca83: 2023-02-13 20:03:32,094 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:32,094 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 20:03:32,095 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2/c87201e081b643c7b3a9c6f25ca04d66, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:32,096 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 40e615ba77a14f152f66739cced6b4f3 in 225ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:32,096 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 40e615ba77a14f152f66739cced6b4f3: 2023-02-13 20:03:32,096 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 20:03:32,096 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:32,096 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. started... 2023-02-13 20:03:32,096 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8d2a9d00d13ed0d8081a57d0c816058f: 2023-02-13 20:03:32,097 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:32,097 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 20:03:32,099 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2/c9af2b2428544fd0b21bfccd9890c44c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:32,100 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c019ce0ac50892e0e02cf665fd9a0143 in 229ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:32,100 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c019ce0ac50892e0e02cf665fd9a0143: 2023-02-13 20:03:32,100 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:32,100 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 20:03:32,106 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/.tmp/f2/ef2f9c064cb04729aee83933ec892a9d as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2/ef2f9c064cb04729aee83933ec892a9d 2023-02-13 20:03:32,123 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2/ef2f9c064cb04729aee83933ec892a9d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:32,125 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bd2aba78ec49b2dd0a3179c4fdffb688 in 253ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:32,125 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bd2aba78ec49b2dd0a3179c4fdffb688: 2023-02-13 20:03:32,125 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:32,125 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 20:03:32,131 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/.tmp/f1/236e332551d14d18a9b1ebc27988ccb9 2023-02-13 20:03:32,131 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/.tmp/f1/f0e0ad5ce23e4785acd9dbd0d242e6d2 2023-02-13 20:03:32,172 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/.tmp/f2/a54a8877018f487bb88671a229bccabc 2023-02-13 20:03:32,176 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/.tmp/f2/8f7e2681e0a045edb6f9f02ecb2978a0 2023-02-13 20:03:32,181 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/.tmp/f1/f0e0ad5ce23e4785acd9dbd0d242e6d2 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1/f0e0ad5ce23e4785acd9dbd0d242e6d2 2023-02-13 20:03:32,185 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/.tmp/f1/236e332551d14d18a9b1ebc27988ccb9 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1/236e332551d14d18a9b1ebc27988ccb9 2023-02-13 20:03:32,188 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1/f0e0ad5ce23e4785acd9dbd0d242e6d2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:32,189 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/.tmp/f2/a54a8877018f487bb88671a229bccabc as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2/a54a8877018f487bb88671a229bccabc 2023-02-13 20:03:32,191 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1/236e332551d14d18a9b1ebc27988ccb9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 20:03:32,193 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/.tmp/f2/8f7e2681e0a045edb6f9f02ecb2978a0 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2/8f7e2681e0a045edb6f9f02ecb2978a0 2023-02-13 20:03:32,195 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2/a54a8877018f487bb88671a229bccabc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:32,196 INFO [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a3484f1c6de9066fea0153c5227abc4d in 128ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:32,196 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a3484f1c6de9066fea0153c5227abc4d: 2023-02-13 20:03:32,196 DEBUG [rs(jenkins-hbase4.apache.org,44139,1676318604684)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:32,197 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 20:03:32,197 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 20:03:32,197 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,197 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 20:03:32,197 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44139,1676318604684' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 20:03:32,200 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2/8f7e2681e0a045edb6f9f02ecb2978a0, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 20:03:32,200 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:32,200 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:32,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:32,201 INFO [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 1ff46d3cf47a857c973f635fc585aaa5 in 122ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:32,201 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1ff46d3cf47a857c973f635fc585aaa5: 2023-02-13 20:03:32,201 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:32,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:32,201 DEBUG [rs(jenkins-hbase4.apache.org,41557,1676318604730)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:32,201 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:32,201 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 20:03:32,201 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 20:03:32,201 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,202 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 20:03:32,202 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41557,1676318604730' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 20:03:32,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:32,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:32,203 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:32,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,203 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,204 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:32,204 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:32,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:32,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44139,1676318604684' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 20:03:32,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55aa4d23[Count = 1] remaining members to acquire global barrier 2023-02-13 20:03:32,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:32,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:32,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:32,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:32,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:32,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:32,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41557,1676318604730' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 20:03:32,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55aa4d23[Count = 0] remaining members to acquire global barrier 2023-02-13 20:03:32,207 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 20:03:32,207 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:32,209 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:32,209 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:32,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:32,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:32,210 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 20:03:32,210 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 20:03:32,210 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,210 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 20:03:32,210 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 20:03:32,210 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,44139,1676318604684' in zk 2023-02-13 20:03:32,210 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41557,1676318604730' in zk 2023-02-13 20:03:32,210 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,210 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:03:32,213 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 20:03:32,213 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:32,213 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,213 DEBUG [member: 'jenkins-hbase4.apache.org,44139,1676318604684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 20:03:32,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:32,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:32,214 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 20:03:32,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:32,214 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,214 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:32,215 DEBUG [member: 'jenkins-hbase4.apache.org,41557,1676318604730' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 20:03:32,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:32,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:32,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:32,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,44139,1676318604684': 2023-02-13 20:03:32,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44139,1676318604684' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-13 20:03:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:32,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,41557,1676318604730': 2023-02-13 20:03:32,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41557,1676318604730' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 20:03:32,223 INFO [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 20:03:32,223 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:03:32,223 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:03:32,223 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 20:03:32,223 INFO [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 20:03:32,226 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:32,226 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:32,226 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:32,226 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:32,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:32,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:32,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:32,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:32,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:32,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:32,226 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:32,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:32,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:32,227 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:32,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:32,228 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,230 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:32,230 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,236 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,236 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:32,236 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:32,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:32,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:32,236 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:32,237 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:32,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:32,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:32,237 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:32,237 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,237 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:32,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 20:03:32,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 20:03:32,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:32,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:32,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:32,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:32,237 DEBUG [(jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:32,237 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:32,239 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:32,239 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:32,240 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:32,240 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:32,240 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 20:03:32,240 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 20:03:32,340 DEBUG [Listener at localhost/39331] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 20:03:32,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 20:03:32,494 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/hadoop-5323312356113646534.jar 2023-02-13 20:03:32,513 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676318610279 type: FLUSH version: 2 ttl: 0 2023-02-13 20:03:32,514 DEBUG [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce 2023-02-13 20:03:32,516 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:32,516 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:32,516 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:32,516 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:32,516 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:32,516 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:32,517 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:32,517 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:32,517 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: 8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:32,517 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(239): region to add: a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:32,517 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=0038ac322ee5c7e7ad5ddc9e194eb8bd as 0038ac322ee5c7e7ad5ddc9e194eb8bd in snapshot testWithMapReduceMultiRegion 2023-02-13 20:03:32,517 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=01673b1d44e4ba19d57c597c9c938de1 as 01673b1d44e4ba19d57c597c9c938de1 in snapshot testWithMapReduceMultiRegion 2023-02-13 20:03:32,517 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=c019ce0ac50892e0e02cf665fd9a0143 as c019ce0ac50892e0e02cf665fd9a0143 in snapshot testWithMapReduceMultiRegion 2023-02-13 20:03:32,518 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=40e615ba77a14f152f66739cced6b4f3 as 40e615ba77a14f152f66739cced6b4f3 in snapshot testWithMapReduceMultiRegion 2023-02-13 20:03:32,518 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=bd2aba78ec49b2dd0a3179c4fdffb688 as bd2aba78ec49b2dd0a3179c4fdffb688 in snapshot testWithMapReduceMultiRegion 2023-02-13 20:03:32,518 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=aa4d100449bf1790cfc36baed2d7590e as aa4d100449bf1790cfc36baed2d7590e in snapshot testWithMapReduceMultiRegion 2023-02-13 20:03:32,518 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=5eb2493284fd88bd0910d9c16859ca83 as 5eb2493284fd88bd0910d9c16859ca83 in snapshot testWithMapReduceMultiRegion 2023-02-13 20:03:32,518 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=1ff46d3cf47a857c973f635fc585aaa5 as 1ff46d3cf47a857c973f635fc585aaa5 in snapshot testWithMapReduceMultiRegion 2023-02-13 20:03:32,518 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=8d2a9d00d13ed0d8081a57d0c816058f as 8d2a9d00d13ed0d8081a57d0c816058f in snapshot testWithMapReduceMultiRegion 2023-02-13 20:03:32,518 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(585): clone region=a3484f1c6de9066fea0153c5227abc4d as a3484f1c6de9066fea0153c5227abc4d in snapshot testWithMapReduceMultiRegion 2023-02-13 20:03:32,528 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 1ff46d3cf47a857c973f635fc585aaa5, NAME => 'testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755 2023-02-13 20:03:32,529 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 5eb2493284fd88bd0910d9c16859ca83, NAME => 'testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755 2023-02-13 20:03:32,529 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0038ac322ee5c7e7ad5ddc9e194eb8bd, NAME => 'testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755 2023-02-13 20:03:32,529 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => aa4d100449bf1790cfc36baed2d7590e, NAME => 'testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755 2023-02-13 20:03:32,530 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => c019ce0ac50892e0e02cf665fd9a0143, NAME => 'testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755 2023-02-13 20:03:32,530 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 40e615ba77a14f152f66739cced6b4f3, NAME => 'testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755 2023-02-13 20:03:32,530 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 01673b1d44e4ba19d57c597c9c938de1, NAME => 'testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755 2023-02-13 20:03:32,532 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => bd2aba78ec49b2dd0a3179c4fdffb688, NAME => 'testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755 2023-02-13 20:03:32,589 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:32,590 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 59381f230b8b4c7a8fd16eba1322f770 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,595 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:32,595 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9f327ba82b5940d5a4d11f7b7bb9bfe3 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,604 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:32,605 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1b722cc4b6c44e48a7bf7be2b7a8f546 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,606 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:32,606 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1c0199bf67134ab8b47ccf02c90bba08 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,608 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ee0d8e776f904b5c9cce7482af4e51ec from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,624 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:32,624 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 27a9c26d12d54d9f90787e6cf5fa3385 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,625 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b5d24c3c637a425b97fb271435b7c6e4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,625 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 01673b1d44e4ba19d57c597c9c938de1, disabling compactions & flushes 2023-02-13 20:03:32,625 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:32,625 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:32,625 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. after waiting 0 ms 2023-02-13 20:03:32,625 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:32,625 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:32,625 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 01673b1d44e4ba19d57c597c9c938de1: Waiting for close lock at 1676318612625Disabling compacts and flushes for region at 1676318612625Disabling writes for close at 1676318612625Writing region close event to WAL at 1676318612625Closed at 1676318612625 2023-02-13 20:03:32,626 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8d2a9d00d13ed0d8081a57d0c816058f, NAME => 'testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755 2023-02-13 20:03:32,640 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 570aa99b4b8c4479b6936f156aa72632 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,641 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 273f1a5311344becbfef1500bb405f83 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,641 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 1ff46d3cf47a857c973f635fc585aaa5, disabling compactions & flushes 2023-02-13 20:03:32,641 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:32,641 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:32,641 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. after waiting 0 ms 2023-02-13 20:03:32,641 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:32,641 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:32,641 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 1ff46d3cf47a857c973f635fc585aaa5: Waiting for close lock at 1676318612641Disabling compacts and flushes for region at 1676318612641Disabling writes for close at 1676318612641Writing region close event to WAL at 1676318612641Closed at 1676318612641 2023-02-13 20:03:32,642 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => a3484f1c6de9066fea0153c5227abc4d, NAME => 'testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755 2023-02-13 20:03:32,643 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:32,643 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1fe67ddc32d84b80add4b59bfa17c5d9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,652 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:32,652 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c0ac94a31b28494f9a276c0e04a32f90 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,657 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing bd2aba78ec49b2dd0a3179c4fdffb688, disabling compactions & flushes 2023-02-13 20:03:32,657 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:32,657 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing c019ce0ac50892e0e02cf665fd9a0143, disabling compactions & flushes 2023-02-13 20:03:32,658 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:32,658 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:32,658 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. after waiting 0 ms 2023-02-13 20:03:32,658 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:32,658 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:32,657 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:32,658 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for c019ce0ac50892e0e02cf665fd9a0143: Waiting for close lock at 1676318612657Disabling compacts and flushes for region at 1676318612657Disabling writes for close at 1676318612658 (+1 ms)Writing region close event to WAL at 1676318612658Closed at 1676318612658 2023-02-13 20:03:32,658 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. after waiting 0 ms 2023-02-13 20:03:32,658 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:32,659 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:32,659 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for bd2aba78ec49b2dd0a3179c4fdffb688: Waiting for close lock at 1676318612657Disabling compacts and flushes for region at 1676318612657Disabling writes for close at 1676318612658 (+1 ms)Writing region close event to WAL at 1676318612659 (+1 ms)Closed at 1676318612659 2023-02-13 20:03:32,659 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 059eb03071bf450eb92cb2f6724594cf from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,660 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:32,660 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 0038ac322ee5c7e7ad5ddc9e194eb8bd, disabling compactions & flushes 2023-02-13 20:03:32,660 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:32,660 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:32,660 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. after waiting 0 ms 2023-02-13 20:03:32,660 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:32,660 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:32,660 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 0038ac322ee5c7e7ad5ddc9e194eb8bd: Waiting for close lock at 1676318612660Disabling compacts and flushes for region at 1676318612660Disabling writes for close at 1676318612660Writing region close event to WAL at 1676318612660Closed at 1676318612660 2023-02-13 20:03:32,663 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 74c9e7e9ca3d45adbb63c5757e235af8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,667 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 5eb2493284fd88bd0910d9c16859ca83, disabling compactions & flushes 2023-02-13 20:03:32,667 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:32,667 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:32,667 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. after waiting 0 ms 2023-02-13 20:03:32,668 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:32,668 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:32,667 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 60730c4a9f7948d9aa55253ba8608cc9 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,668 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:32,668 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 5eb2493284fd88bd0910d9c16859ca83: Waiting for close lock at 1676318612667Disabling compacts and flushes for region at 1676318612667Disabling writes for close at 1676318612668 (+1 ms)Writing region close event to WAL at 1676318612668Closed at 1676318612668 2023-02-13 20:03:32,670 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 8d2a9d00d13ed0d8081a57d0c816058f, disabling compactions & flushes 2023-02-13 20:03:32,670 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:32,670 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:32,670 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. after waiting 0 ms 2023-02-13 20:03:32,670 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:32,670 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:32,670 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 8d2a9d00d13ed0d8081a57d0c816058f: Waiting for close lock at 1676318612670Disabling compacts and flushes for region at 1676318612670Disabling writes for close at 1676318612670Writing region close event to WAL at 1676318612670Closed at 1676318612670 2023-02-13 20:03:32,670 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 40e615ba77a14f152f66739cced6b4f3, disabling compactions & flushes 2023-02-13 20:03:32,670 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:32,670 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:32,670 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:32,671 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 65b9486249c04a468f33ffda0fa5db15 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,670 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. after waiting 0 ms 2023-02-13 20:03:32,671 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:32,671 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:32,671 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 40e615ba77a14f152f66739cced6b4f3: Waiting for close lock at 1676318612670Disabling compacts and flushes for region at 1676318612670Disabling writes for close at 1676318612671 (+1 ms)Writing region close event to WAL at 1676318612671Closed at 1676318612671 2023-02-13 20:03:32,674 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing aa4d100449bf1790cfc36baed2d7590e, disabling compactions & flushes 2023-02-13 20:03:32,674 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9634e0e0807c4270a9a016c4f7183449 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 20:03:32,674 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:32,674 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:32,674 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. after waiting 0 ms 2023-02-13 20:03:32,674 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:32,674 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:32,674 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for aa4d100449bf1790cfc36baed2d7590e: Waiting for close lock at 1676318612674Disabling compacts and flushes for region at 1676318612674Disabling writes for close at 1676318612674Writing region close event to WAL at 1676318612674Closed at 1676318612674 2023-02-13 20:03:32,676 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing a3484f1c6de9066fea0153c5227abc4d, disabling compactions & flushes 2023-02-13 20:03:32,676 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:32,677 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:32,677 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. after waiting 0 ms 2023-02-13 20:03:32,677 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:32,677 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:32,677 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for a3484f1c6de9066fea0153c5227abc4d: Waiting for close lock at 1676318612676Disabling compacts and flushes for region at 1676318612676Disabling writes for close at 1676318612677 (+1 ms)Writing region close event to WAL at 1676318612677Closed at 1676318612677 2023-02-13 20:03:32,677 INFO [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676318610279 type: FLUSH version: 2 ttl: 0 2023-02-13 20:03:32,677 DEBUG [Listener at localhost/39331] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755 2023-02-13 20:03:32,677 DEBUG [Listener at localhost/39331] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755 2023-02-13 20:03:32,678 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-data/ 2023-02-13 20:03:32,679 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----default/ 2023-02-13 20:03:32,679 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 20:03:32,680 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------0038ac322ee5c7e7ad5ddc9e194eb8bd/ 2023-02-13 20:03:32,681 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:32,681 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------01673b1d44e4ba19d57c597c9c938de1/ 2023-02-13 20:03:32,681 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:32,681 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:32,682 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=01673b1d44e4ba19d57c597c9c938de1-59381f230b8b4c7a8fd16eba1322f770 2023-02-13 20:03:32,682 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:32,682 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=01673b1d44e4ba19d57c597c9c938de1-ee0d8e776f904b5c9cce7482af4e51ec 2023-02-13 20:03:32,683 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------1ff46d3cf47a857c973f635fc585aaa5/ 2023-02-13 20:03:32,683 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:32,683 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:32,684 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=1ff46d3cf47a857c973f635fc585aaa5-9f327ba82b5940d5a4d11f7b7bb9bfe3 2023-02-13 20:03:32,684 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:32,684 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=1ff46d3cf47a857c973f635fc585aaa5-b5d24c3c637a425b97fb271435b7c6e4 2023-02-13 20:03:32,685 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------40e615ba77a14f152f66739cced6b4f3/ 2023-02-13 20:03:32,685 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:32,685 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:32,686 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=40e615ba77a14f152f66739cced6b4f3-1fe67ddc32d84b80add4b59bfa17c5d9 2023-02-13 20:03:32,686 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:32,686 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=40e615ba77a14f152f66739cced6b4f3-74c9e7e9ca3d45adbb63c5757e235af8 2023-02-13 20:03:32,686 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------5eb2493284fd88bd0910d9c16859ca83/ 2023-02-13 20:03:32,687 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:32,687 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:32,687 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=5eb2493284fd88bd0910d9c16859ca83-27a9c26d12d54d9f90787e6cf5fa3385 2023-02-13 20:03:32,688 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:32,688 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=5eb2493284fd88bd0910d9c16859ca83-059eb03071bf450eb92cb2f6724594cf 2023-02-13 20:03:32,688 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------8d2a9d00d13ed0d8081a57d0c816058f/ 2023-02-13 20:03:32,689 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:32,689 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------a3484f1c6de9066fea0153c5227abc4d/ 2023-02-13 20:03:32,690 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:32,690 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:32,690 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=a3484f1c6de9066fea0153c5227abc4d-65b9486249c04a468f33ffda0fa5db15 2023-02-13 20:03:32,690 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:32,691 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=a3484f1c6de9066fea0153c5227abc4d-9634e0e0807c4270a9a016c4f7183449 2023-02-13 20:03:32,691 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------aa4d100449bf1790cfc36baed2d7590e/ 2023-02-13 20:03:32,691 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:32,691 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:32,692 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=aa4d100449bf1790cfc36baed2d7590e-c0ac94a31b28494f9a276c0e04a32f90 2023-02-13 20:03:32,692 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:32,692 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=aa4d100449bf1790cfc36baed2d7590e-60730c4a9f7948d9aa55253ba8608cc9 2023-02-13 20:03:32,692 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------bd2aba78ec49b2dd0a3179c4fdffb688/ 2023-02-13 20:03:32,693 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:32,693 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:32,693 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=bd2aba78ec49b2dd0a3179c4fdffb688-1c0199bf67134ab8b47ccf02c90bba08 2023-02-13 20:03:32,693 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:32,694 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=bd2aba78ec49b2dd0a3179c4fdffb688-570aa99b4b8c4479b6936f156aa72632 2023-02-13 20:03:32,694 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |----------c019ce0ac50892e0e02cf665fd9a0143/ 2023-02-13 20:03:32,695 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:32,695 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:32,695 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=c019ce0ac50892e0e02cf665fd9a0143-1b722cc4b6c44e48a7bf7be2b7a8f546 2023-02-13 20:03:32,695 DEBUG [Listener at localhost/39331] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:32,696 DEBUG [Listener at localhost/39331] util.CommonFSUtils(702): |----------------testWithMapReduce=c019ce0ac50892e0e02cf665fd9a0143-273f1a5311344becbfef1500bb405f83 2023-02-13 20:03:32,704 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,705 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,705 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,706 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,706 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,706 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,707 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,781 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/hadoop-3316992538944784831.jar 2023-02-13 20:03:32,782 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,782 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,783 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,783 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,784 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,784 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,785 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 20:03:32,785 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 20:03:32,786 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 20:03:32,786 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 20:03:32,787 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 20:03:32,788 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 20:03:32,789 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 20:03:32,789 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 20:03:32,790 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 20:03:32,791 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 20:03:32,797 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:32,797 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 20:03:32,798 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 20:03:32,798 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 20:03:32,799 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 20:03:32,868 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/hadoop-3503880708796160616.jar 2023-02-13 20:03:32,869 DEBUG [Listener at localhost/39331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 20:03:32,917 WARN [Listener at localhost/39331] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 20:03:32,941 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 20:03:33,082 INFO [Listener at localhost/39331] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 20:03:33,127 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 20:03:33,130 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 20:03:33,459 WARN [Listener at localhost/39331] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/mapreduce.cluster.local.dir/1676318613384/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 20:03:33,459 WARN [Listener at localhost/39331] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/mapreduce.cluster.local.dir/1676318613384/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 20:03:33,602 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:33,602 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:33,604 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:33,606 INFO [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:33,608 DEBUG [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd/f1 2023-02-13 20:03:33,608 INFO [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0038ac322ee5c7e7ad5ddc9e194eb8bd columnFamilyName f1 2023-02-13 20:03:33,609 INFO [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] regionserver.HStore(310): Store=0038ac322ee5c7e7ad5ddc9e194eb8bd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:33,609 INFO [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:33,611 DEBUG [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd/f2 2023-02-13 20:03:33,611 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 20:03:33,611 INFO [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0038ac322ee5c7e7ad5ddc9e194eb8bd columnFamilyName f2 2023-02-13 20:03:33,612 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-13 20:03:33,612 INFO [StoreOpener-0038ac322ee5c7e7ad5ddc9e194eb8bd-1] regionserver.HStore(310): Store=0038ac322ee5c7e7ad5ddc9e194eb8bd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:33,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:33,613 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0038ac322ee5c7e7ad5ddc9e194eb8bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72269494, jitterRate=0.07689937949180603}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:33,613 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0038ac322ee5c7e7ad5ddc9e194eb8bd: Writing region info on filesystem at 1676318613604Initializing all the Stores at 1676318613605 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318613605Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318613605Region opened successfully at 1676318613613 (+8 ms) 2023-02-13 20:03:33,655 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0038ac322ee5c7e7ad5ddc9e194eb8bd, disabling compactions & flushes 2023-02-13 20:03:33,655 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:33,655 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:33,656 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. after waiting 0 ms 2023-02-13 20:03:33,656 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:33,656 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:33,656 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0038ac322ee5c7e7ad5ddc9e194eb8bd: Waiting for close lock at 1676318613655Disabling compacts and flushes for region at 1676318613655Disabling writes for close at 1676318613656 (+1 ms)Writing region close event to WAL at 1676318613656Closed at 1676318613656 2023-02-13 20:03:33,671 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:33,671 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:33,673 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:33,675 INFO [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:33,676 DEBUG [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1 2023-02-13 20:03:33,677 INFO [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ff46d3cf47a857c973f635fc585aaa5 columnFamilyName f1 2023-02-13 20:03:33,685 DEBUG [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1/testWithMapReduce=1ff46d3cf47a857c973f635fc585aaa5-9f327ba82b5940d5a4d11f7b7bb9bfe3 2023-02-13 20:03:33,686 INFO [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] regionserver.HStore(310): Store=1ff46d3cf47a857c973f635fc585aaa5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:33,686 INFO [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:33,687 DEBUG [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2 2023-02-13 20:03:33,688 INFO [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ff46d3cf47a857c973f635fc585aaa5 columnFamilyName f2 2023-02-13 20:03:33,694 DEBUG [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2/testWithMapReduce=1ff46d3cf47a857c973f635fc585aaa5-b5d24c3c637a425b97fb271435b7c6e4 2023-02-13 20:03:33,694 INFO [StoreOpener-1ff46d3cf47a857c973f635fc585aaa5-1] regionserver.HStore(310): Store=1ff46d3cf47a857c973f635fc585aaa5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:33,695 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:33,695 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1ff46d3cf47a857c973f635fc585aaa5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59949234, jitterRate=-0.1066868007183075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:33,695 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1ff46d3cf47a857c973f635fc585aaa5: Writing region info on filesystem at 1676318613673Initializing all the Stores at 1676318613674 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318613674Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318613674Region opened successfully at 1676318613695 (+21 ms) 2023-02-13 20:03:33,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1ff46d3cf47a857c973f635fc585aaa5, disabling compactions & flushes 2023-02-13 20:03:33,833 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:33,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:33,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. after waiting 0 ms 2023-02-13 20:03:33,833 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:33,841 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:33,841 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1ff46d3cf47a857c973f635fc585aaa5: Waiting for close lock at 1676318613833Disabling compacts and flushes for region at 1676318613833Disabling writes for close at 1676318613833Writing region close event to WAL at 1676318613841 (+8 ms)Closed at 1676318613841 2023-02-13 20:03:33,846 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:33,846 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:33,852 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:33,854 INFO [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:33,855 DEBUG [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1 2023-02-13 20:03:33,856 INFO [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01673b1d44e4ba19d57c597c9c938de1 columnFamilyName f1 2023-02-13 20:03:33,863 DEBUG [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1/testWithMapReduce=01673b1d44e4ba19d57c597c9c938de1-59381f230b8b4c7a8fd16eba1322f770 2023-02-13 20:03:33,863 INFO [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] regionserver.HStore(310): Store=01673b1d44e4ba19d57c597c9c938de1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:33,863 INFO [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:33,865 DEBUG [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2 2023-02-13 20:03:33,865 INFO [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01673b1d44e4ba19d57c597c9c938de1 columnFamilyName f2 2023-02-13 20:03:33,872 DEBUG [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2/testWithMapReduce=01673b1d44e4ba19d57c597c9c938de1-ee0d8e776f904b5c9cce7482af4e51ec 2023-02-13 20:03:33,872 INFO [StoreOpener-01673b1d44e4ba19d57c597c9c938de1-1] regionserver.HStore(310): Store=01673b1d44e4ba19d57c597c9c938de1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:33,873 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:33,873 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 01673b1d44e4ba19d57c597c9c938de1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69664579, jitterRate=0.03808312118053436}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:33,873 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 01673b1d44e4ba19d57c597c9c938de1: Writing region info on filesystem at 1676318613852Initializing all the Stores at 1676318613853 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318613853Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318613853Region opened successfully at 1676318613873 (+20 ms) 2023-02-13 20:03:33,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 01673b1d44e4ba19d57c597c9c938de1, disabling compactions & flushes 2023-02-13 20:03:33,933 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:33,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:33,934 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. after waiting 0 ms 2023-02-13 20:03:33,934 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:33,939 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:33,939 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 01673b1d44e4ba19d57c597c9c938de1: Waiting for close lock at 1676318613933Disabling compacts and flushes for region at 1676318613933Disabling writes for close at 1676318613934 (+1 ms)Writing region close event to WAL at 1676318613939 (+5 ms)Closed at 1676318613939 2023-02-13 20:03:33,945 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:33,945 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:33,947 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:33,949 INFO [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:33,950 DEBUG [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1 2023-02-13 20:03:33,951 INFO [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40e615ba77a14f152f66739cced6b4f3 columnFamilyName f1 2023-02-13 20:03:33,957 DEBUG [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1/testWithMapReduce=40e615ba77a14f152f66739cced6b4f3-1fe67ddc32d84b80add4b59bfa17c5d9 2023-02-13 20:03:33,958 INFO [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] regionserver.HStore(310): Store=40e615ba77a14f152f66739cced6b4f3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:33,958 INFO [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:33,959 DEBUG [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2 2023-02-13 20:03:33,960 INFO [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40e615ba77a14f152f66739cced6b4f3 columnFamilyName f2 2023-02-13 20:03:33,966 DEBUG [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2/testWithMapReduce=40e615ba77a14f152f66739cced6b4f3-74c9e7e9ca3d45adbb63c5757e235af8 2023-02-13 20:03:33,966 INFO [StoreOpener-40e615ba77a14f152f66739cced6b4f3-1] regionserver.HStore(310): Store=40e615ba77a14f152f66739cced6b4f3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:33,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:33,967 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 40e615ba77a14f152f66739cced6b4f3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72210568, jitterRate=0.07602131366729736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:33,967 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 40e615ba77a14f152f66739cced6b4f3: Writing region info on filesystem at 1676318613947Initializing all the Stores at 1676318613948 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318613948Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318613949 (+1 ms)Region opened successfully at 1676318613967 (+18 ms) 2023-02-13 20:03:34,017 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 40e615ba77a14f152f66739cced6b4f3, disabling compactions & flushes 2023-02-13 20:03:34,018 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:34,018 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:34,018 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. after waiting 0 ms 2023-02-13 20:03:34,018 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:34,021 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:34,021 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 40e615ba77a14f152f66739cced6b4f3: Waiting for close lock at 1676318614017Disabling compacts and flushes for region at 1676318614017Disabling writes for close at 1676318614018 (+1 ms)Writing region close event to WAL at 1676318614021 (+3 ms)Closed at 1676318614021 2023-02-13 20:03:34,027 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:34,027 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:34,032 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:34,037 INFO [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:34,038 DEBUG [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1 2023-02-13 20:03:34,039 INFO [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5eb2493284fd88bd0910d9c16859ca83 columnFamilyName f1 2023-02-13 20:03:34,046 DEBUG [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1/testWithMapReduce=5eb2493284fd88bd0910d9c16859ca83-27a9c26d12d54d9f90787e6cf5fa3385 2023-02-13 20:03:34,046 INFO [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] regionserver.HStore(310): Store=5eb2493284fd88bd0910d9c16859ca83/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:34,046 INFO [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:34,047 DEBUG [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2 2023-02-13 20:03:34,048 INFO [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5eb2493284fd88bd0910d9c16859ca83 columnFamilyName f2 2023-02-13 20:03:34,056 DEBUG [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2/testWithMapReduce=5eb2493284fd88bd0910d9c16859ca83-059eb03071bf450eb92cb2f6724594cf 2023-02-13 20:03:34,056 INFO [StoreOpener-5eb2493284fd88bd0910d9c16859ca83-1] regionserver.HStore(310): Store=5eb2493284fd88bd0910d9c16859ca83/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:34,057 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:34,057 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5eb2493284fd88bd0910d9c16859ca83; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68800331, jitterRate=0.025204822421073914}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:34,057 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5eb2493284fd88bd0910d9c16859ca83: Writing region info on filesystem at 1676318614032Initializing all the Stores at 1676318614033 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318614033Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318614036 (+3 ms)Region opened successfully at 1676318614057 (+21 ms) 2023-02-13 20:03:34,123 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5eb2493284fd88bd0910d9c16859ca83, disabling compactions & flushes 2023-02-13 20:03:34,124 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:34,124 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:34,124 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. after waiting 0 ms 2023-02-13 20:03:34,124 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:34,126 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:34,126 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5eb2493284fd88bd0910d9c16859ca83: Waiting for close lock at 1676318614123Disabling compacts and flushes for region at 1676318614123Disabling writes for close at 1676318614124 (+1 ms)Writing region close event to WAL at 1676318614126 (+2 ms)Closed at 1676318614126 2023-02-13 20:03:34,132 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:34,133 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:34,134 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:34,136 INFO [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:34,137 DEBUG [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1 2023-02-13 20:03:34,137 INFO [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3484f1c6de9066fea0153c5227abc4d columnFamilyName f1 2023-02-13 20:03:34,144 DEBUG [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1/testWithMapReduce=a3484f1c6de9066fea0153c5227abc4d-65b9486249c04a468f33ffda0fa5db15 2023-02-13 20:03:34,145 INFO [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] regionserver.HStore(310): Store=a3484f1c6de9066fea0153c5227abc4d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:34,145 INFO [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:34,146 DEBUG [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2 2023-02-13 20:03:34,146 INFO [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3484f1c6de9066fea0153c5227abc4d columnFamilyName f2 2023-02-13 20:03:34,155 DEBUG [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2/testWithMapReduce=a3484f1c6de9066fea0153c5227abc4d-9634e0e0807c4270a9a016c4f7183449 2023-02-13 20:03:34,156 INFO [StoreOpener-a3484f1c6de9066fea0153c5227abc4d-1] regionserver.HStore(310): Store=a3484f1c6de9066fea0153c5227abc4d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:34,156 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:34,156 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a3484f1c6de9066fea0153c5227abc4d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63687845, jitterRate=-0.050977155566215515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:34,156 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a3484f1c6de9066fea0153c5227abc4d: Writing region info on filesystem at 1676318614134Initializing all the Stores at 1676318614135 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318614135Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318614135Region opened successfully at 1676318614156 (+21 ms) 2023-02-13 20:03:34,190 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a3484f1c6de9066fea0153c5227abc4d, disabling compactions & flushes 2023-02-13 20:03:34,190 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:34,190 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:34,190 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. after waiting 0 ms 2023-02-13 20:03:34,190 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:34,193 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:34,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a3484f1c6de9066fea0153c5227abc4d: Waiting for close lock at 1676318614189Disabling compacts and flushes for region at 1676318614189Disabling writes for close at 1676318614190 (+1 ms)Writing region close event to WAL at 1676318614193 (+3 ms)Closed at 1676318614193 2023-02-13 20:03:34,197 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:34,197 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:34,198 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:34,200 INFO [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:34,201 DEBUG [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1 2023-02-13 20:03:34,202 INFO [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c019ce0ac50892e0e02cf665fd9a0143 columnFamilyName f1 2023-02-13 20:03:34,208 DEBUG [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1/testWithMapReduce=c019ce0ac50892e0e02cf665fd9a0143-1b722cc4b6c44e48a7bf7be2b7a8f546 2023-02-13 20:03:34,208 INFO [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] regionserver.HStore(310): Store=c019ce0ac50892e0e02cf665fd9a0143/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:34,209 INFO [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:34,210 DEBUG [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2 2023-02-13 20:03:34,210 INFO [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c019ce0ac50892e0e02cf665fd9a0143 columnFamilyName f2 2023-02-13 20:03:34,215 DEBUG [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2/testWithMapReduce=c019ce0ac50892e0e02cf665fd9a0143-273f1a5311344becbfef1500bb405f83 2023-02-13 20:03:34,215 INFO [StoreOpener-c019ce0ac50892e0e02cf665fd9a0143-1] regionserver.HStore(310): Store=c019ce0ac50892e0e02cf665fd9a0143/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:34,216 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:34,216 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c019ce0ac50892e0e02cf665fd9a0143; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73429356, jitterRate=0.09418267011642456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:34,216 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c019ce0ac50892e0e02cf665fd9a0143: Writing region info on filesystem at 1676318614198Initializing all the Stores at 1676318614199 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318614199Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318614200 (+1 ms)Region opened successfully at 1676318614216 (+16 ms) 2023-02-13 20:03:34,253 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c019ce0ac50892e0e02cf665fd9a0143, disabling compactions & flushes 2023-02-13 20:03:34,253 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:34,253 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:34,253 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. after waiting 0 ms 2023-02-13 20:03:34,253 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:34,257 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:34,257 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c019ce0ac50892e0e02cf665fd9a0143: Waiting for close lock at 1676318614253Disabling compacts and flushes for region at 1676318614253Disabling writes for close at 1676318614253Writing region close event to WAL at 1676318614257 (+4 ms)Closed at 1676318614257 2023-02-13 20:03:34,264 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:34,264 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:34,269 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:34,271 INFO [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:34,272 DEBUG [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1 2023-02-13 20:03:34,272 INFO [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa4d100449bf1790cfc36baed2d7590e columnFamilyName f1 2023-02-13 20:03:34,279 DEBUG [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1/testWithMapReduce=aa4d100449bf1790cfc36baed2d7590e-c0ac94a31b28494f9a276c0e04a32f90 2023-02-13 20:03:34,279 INFO [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] regionserver.HStore(310): Store=aa4d100449bf1790cfc36baed2d7590e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:34,279 INFO [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:34,280 DEBUG [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2 2023-02-13 20:03:34,281 INFO [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa4d100449bf1790cfc36baed2d7590e columnFamilyName f2 2023-02-13 20:03:34,287 DEBUG [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2/testWithMapReduce=aa4d100449bf1790cfc36baed2d7590e-60730c4a9f7948d9aa55253ba8608cc9 2023-02-13 20:03:34,287 INFO [StoreOpener-aa4d100449bf1790cfc36baed2d7590e-1] regionserver.HStore(310): Store=aa4d100449bf1790cfc36baed2d7590e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:34,287 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:34,287 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened aa4d100449bf1790cfc36baed2d7590e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62199279, jitterRate=-0.07315851747989655}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:34,288 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for aa4d100449bf1790cfc36baed2d7590e: Writing region info on filesystem at 1676318614269Initializing all the Stores at 1676318614270 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318614270Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318614270Region opened successfully at 1676318614288 (+18 ms) 2023-02-13 20:03:34,323 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing aa4d100449bf1790cfc36baed2d7590e, disabling compactions & flushes 2023-02-13 20:03:34,323 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:34,323 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:34,323 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. after waiting 0 ms 2023-02-13 20:03:34,323 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:34,327 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:34,327 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for aa4d100449bf1790cfc36baed2d7590e: Waiting for close lock at 1676318614323Disabling compacts and flushes for region at 1676318614323Disabling writes for close at 1676318614323Writing region close event to WAL at 1676318614327 (+4 ms)Closed at 1676318614327 2023-02-13 20:03:34,333 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:34,333 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:34,337 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:34,339 INFO [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:34,341 DEBUG [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f/f1 2023-02-13 20:03:34,341 INFO [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d2a9d00d13ed0d8081a57d0c816058f columnFamilyName f1 2023-02-13 20:03:34,342 INFO [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] regionserver.HStore(310): Store=8d2a9d00d13ed0d8081a57d0c816058f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:34,342 INFO [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:34,344 DEBUG [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f/f2 2023-02-13 20:03:34,344 INFO [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d2a9d00d13ed0d8081a57d0c816058f columnFamilyName f2 2023-02-13 20:03:34,345 INFO [StoreOpener-8d2a9d00d13ed0d8081a57d0c816058f-1] regionserver.HStore(310): Store=8d2a9d00d13ed0d8081a57d0c816058f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:34,345 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:34,345 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8d2a9d00d13ed0d8081a57d0c816058f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75312885, jitterRate=0.12224943935871124}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:34,345 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8d2a9d00d13ed0d8081a57d0c816058f: Writing region info on filesystem at 1676318614337Initializing all the Stores at 1676318614337Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318614337Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318614338 (+1 ms)Region opened successfully at 1676318614345 (+7 ms) 2023-02-13 20:03:34,366 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8d2a9d00d13ed0d8081a57d0c816058f, disabling compactions & flushes 2023-02-13 20:03:34,366 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:34,366 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:34,366 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. after waiting 0 ms 2023-02-13 20:03:34,366 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:34,366 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:34,366 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8d2a9d00d13ed0d8081a57d0c816058f: Waiting for close lock at 1676318614366Disabling compacts and flushes for region at 1676318614366Disabling writes for close at 1676318614366Writing region close event to WAL at 1676318614366Closed at 1676318614366 2023-02-13 20:03:34,370 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:34,370 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:34,371 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:34,374 INFO [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:34,375 DEBUG [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1 2023-02-13 20:03:34,376 INFO [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd2aba78ec49b2dd0a3179c4fdffb688 columnFamilyName f1 2023-02-13 20:03:34,382 DEBUG [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1/testWithMapReduce=bd2aba78ec49b2dd0a3179c4fdffb688-1c0199bf67134ab8b47ccf02c90bba08 2023-02-13 20:03:34,383 INFO [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] regionserver.HStore(310): Store=bd2aba78ec49b2dd0a3179c4fdffb688/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:34,383 INFO [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:34,384 DEBUG [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2 2023-02-13 20:03:34,384 INFO [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd2aba78ec49b2dd0a3179c4fdffb688 columnFamilyName f2 2023-02-13 20:03:34,391 DEBUG [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] regionserver.HStore(539): loaded hdfs://localhost:36203/user/jenkins/test-data/2ff6a798-ed73-6e86-e74e-3e43532173d8/testWithMapReduceMultiRegion/2b24b59e-223e-45b9-b063-380475638755/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2/testWithMapReduce=bd2aba78ec49b2dd0a3179c4fdffb688-570aa99b4b8c4479b6936f156aa72632 2023-02-13 20:03:34,391 INFO [StoreOpener-bd2aba78ec49b2dd0a3179c4fdffb688-1] regionserver.HStore(310): Store=bd2aba78ec49b2dd0a3179c4fdffb688/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:34,391 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:34,391 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bd2aba78ec49b2dd0a3179c4fdffb688; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73393796, jitterRate=0.09365278482437134}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:34,391 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bd2aba78ec49b2dd0a3179c4fdffb688: Writing region info on filesystem at 1676318614372Initializing all the Stores at 1676318614372Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318614373 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318614373Region opened successfully at 1676318614391 (+18 ms) 2023-02-13 20:03:34,442 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bd2aba78ec49b2dd0a3179c4fdffb688, disabling compactions & flushes 2023-02-13 20:03:34,442 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:34,442 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:34,442 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. after waiting 0 ms 2023-02-13 20:03:34,442 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:34,446 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:34,446 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bd2aba78ec49b2dd0a3179c4fdffb688: Waiting for close lock at 1676318614442Disabling compacts and flushes for region at 1676318614442Disabling writes for close at 1676318614442Writing region close event to WAL at 1676318614446 (+4 ms)Closed at 1676318614446 2023-02-13 20:03:35,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-13 20:03:35,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-13 20:03:35,559 INFO [Listener at localhost/39331] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 20:03:35,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 20:03:35,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-13 20:03:35,569 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318615569"}]},"ts":"1676318615569"} 2023-02-13 20:03:35,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 20:03:35,571 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-13 20:03:35,574 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-13 20:03:35,586 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8d2a9d00d13ed0d8081a57d0c816058f, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1ff46d3cf47a857c973f635fc585aaa5, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c019ce0ac50892e0e02cf665fd9a0143, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a3484f1c6de9066fea0153c5227abc4d, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=aa4d100449bf1790cfc36baed2d7590e, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=01673b1d44e4ba19d57c597c9c938de1, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bd2aba78ec49b2dd0a3179c4fdffb688, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=40e615ba77a14f152f66739cced6b4f3, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5eb2493284fd88bd0910d9c16859ca83, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0038ac322ee5c7e7ad5ddc9e194eb8bd, UNASSIGN}] 2023-02-13 20:03:35,588 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=0038ac322ee5c7e7ad5ddc9e194eb8bd, UNASSIGN 2023-02-13 20:03:35,588 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=40e615ba77a14f152f66739cced6b4f3, UNASSIGN 2023-02-13 20:03:35,588 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bd2aba78ec49b2dd0a3179c4fdffb688, UNASSIGN 2023-02-13 20:03:35,589 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5eb2493284fd88bd0910d9c16859ca83, UNASSIGN 2023-02-13 20:03:35,589 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=01673b1d44e4ba19d57c597c9c938de1, UNASSIGN 2023-02-13 20:03:35,591 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=40e615ba77a14f152f66739cced6b4f3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:35,591 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=bd2aba78ec49b2dd0a3179c4fdffb688, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:35,591 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=5eb2493284fd88bd0910d9c16859ca83, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:35,591 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318615591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318615591"}]},"ts":"1676318615591"} 2023-02-13 20:03:35,591 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=01673b1d44e4ba19d57c597c9c938de1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:35,591 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0038ac322ee5c7e7ad5ddc9e194eb8bd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:35,591 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318615591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318615591"}]},"ts":"1676318615591"} 2023-02-13 20:03:35,592 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318615591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318615591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318615591"}]},"ts":"1676318615591"} 2023-02-13 20:03:35,591 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318615591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318615591"}]},"ts":"1676318615591"} 2023-02-13 20:03:35,591 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318615591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318615591"}]},"ts":"1676318615591"} 2023-02-13 20:03:35,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=41, state=RUNNABLE; CloseRegionProcedure 40e615ba77a14f152f66739cced6b4f3, server=jenkins-hbase4.apache.org,41557,1676318604730}] 2023-02-13 20:03:35,596 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=39, state=RUNNABLE; CloseRegionProcedure 01673b1d44e4ba19d57c597c9c938de1, server=jenkins-hbase4.apache.org,44139,1676318604684}] 2023-02-13 20:03:35,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; CloseRegionProcedure 0038ac322ee5c7e7ad5ddc9e194eb8bd, server=jenkins-hbase4.apache.org,44139,1676318604684}] 2023-02-13 20:03:35,598 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=42, state=RUNNABLE; CloseRegionProcedure 5eb2493284fd88bd0910d9c16859ca83, server=jenkins-hbase4.apache.org,44139,1676318604684}] 2023-02-13 20:03:35,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=40, state=RUNNABLE; CloseRegionProcedure bd2aba78ec49b2dd0a3179c4fdffb688, server=jenkins-hbase4.apache.org,41557,1676318604730}] 2023-02-13 20:03:35,605 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=aa4d100449bf1790cfc36baed2d7590e, UNASSIGN 2023-02-13 20:03:35,605 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a3484f1c6de9066fea0153c5227abc4d, UNASSIGN 2023-02-13 20:03:35,605 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=1ff46d3cf47a857c973f635fc585aaa5, UNASSIGN 2023-02-13 20:03:35,605 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=c019ce0ac50892e0e02cf665fd9a0143, UNASSIGN 2023-02-13 20:03:35,606 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8d2a9d00d13ed0d8081a57d0c816058f, UNASSIGN 2023-02-13 20:03:35,606 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=aa4d100449bf1790cfc36baed2d7590e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:35,606 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=1ff46d3cf47a857c973f635fc585aaa5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:35,606 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318615606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318615606"}]},"ts":"1676318615606"} 2023-02-13 20:03:35,606 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318615606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318615606"}]},"ts":"1676318615606"} 2023-02-13 20:03:35,606 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a3484f1c6de9066fea0153c5227abc4d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:35,607 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318615606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318615606"}]},"ts":"1676318615606"} 2023-02-13 20:03:35,607 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c019ce0ac50892e0e02cf665fd9a0143, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:35,607 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318615607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318615607"}]},"ts":"1676318615607"} 2023-02-13 20:03:35,607 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=8d2a9d00d13ed0d8081a57d0c816058f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:35,607 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318615607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318615607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318615607"}]},"ts":"1676318615607"} 2023-02-13 20:03:35,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure aa4d100449bf1790cfc36baed2d7590e, server=jenkins-hbase4.apache.org,41557,1676318604730}] 2023-02-13 20:03:35,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=35, state=RUNNABLE; CloseRegionProcedure 1ff46d3cf47a857c973f635fc585aaa5, server=jenkins-hbase4.apache.org,41557,1676318604730}] 2023-02-13 20:03:35,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=37, state=RUNNABLE; CloseRegionProcedure a3484f1c6de9066fea0153c5227abc4d, server=jenkins-hbase4.apache.org,44139,1676318604684}] 2023-02-13 20:03:35,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=36, state=RUNNABLE; CloseRegionProcedure c019ce0ac50892e0e02cf665fd9a0143, server=jenkins-hbase4.apache.org,44139,1676318604684}] 2023-02-13 20:03:35,618 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 8d2a9d00d13ed0d8081a57d0c816058f, server=jenkins-hbase4.apache.org,41557,1676318604730}] 2023-02-13 20:03:35,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 20:03:35,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:35,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:35,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 40e615ba77a14f152f66739cced6b4f3, disabling compactions & flushes 2023-02-13 20:03:35,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 01673b1d44e4ba19d57c597c9c938de1, disabling compactions & flushes 2023-02-13 20:03:35,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:35,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:35,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:35,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:35,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. after waiting 0 ms 2023-02-13 20:03:35,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:35,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. after waiting 0 ms 2023-02-13 20:03:35,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:35,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:35,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:35,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3. 2023-02-13 20:03:35,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1. 2023-02-13 20:03:35,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 01673b1d44e4ba19d57c597c9c938de1: Waiting for close lock at 1676318615758Running coprocessor pre-close hooks at 1676318615758Disabling compacts and flushes for region at 1676318615758Disabling writes for close at 1676318615758Writing region close event to WAL at 1676318615767 (+9 ms)Running coprocessor post-close hooks at 1676318615774 (+7 ms)Closed at 1676318615775 (+1 ms) 2023-02-13 20:03:35,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 40e615ba77a14f152f66739cced6b4f3: Waiting for close lock at 1676318615757Running coprocessor pre-close hooks at 1676318615757Disabling compacts and flushes for region at 1676318615757Disabling writes for close at 1676318615758 (+1 ms)Writing region close event to WAL at 1676318615769 (+11 ms)Running coprocessor post-close hooks at 1676318615774 (+5 ms)Closed at 1676318615775 (+1 ms) 2023-02-13 20:03:35,781 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=40e615ba77a14f152f66739cced6b4f3, regionState=CLOSED 2023-02-13 20:03:35,782 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615781"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318615781"}]},"ts":"1676318615781"} 2023-02-13 20:03:35,782 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=01673b1d44e4ba19d57c597c9c938de1, regionState=CLOSED 2023-02-13 20:03:35,783 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615782"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318615782"}]},"ts":"1676318615782"} 2023-02-13 20:03:35,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=41 2023-02-13 20:03:35,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=41, state=SUCCESS; CloseRegionProcedure 40e615ba77a14f152f66739cced6b4f3, server=jenkins-hbase4.apache.org,41557,1676318604730 in 189 msec 2023-02-13 20:03:35,787 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=39 2023-02-13 20:03:35,787 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=39, state=SUCCESS; CloseRegionProcedure 01673b1d44e4ba19d57c597c9c938de1, server=jenkins-hbase4.apache.org,44139,1676318604684 in 189 msec 2023-02-13 20:03:35,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:35,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:35,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:35,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bd2aba78ec49b2dd0a3179c4fdffb688, disabling compactions & flushes 2023-02-13 20:03:35,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:35,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:35,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. after waiting 0 ms 2023-02-13 20:03:35,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:35,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=40e615ba77a14f152f66739cced6b4f3, UNASSIGN in 210 msec 2023-02-13 20:03:35,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:35,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c019ce0ac50892e0e02cf665fd9a0143, disabling compactions & flushes 2023-02-13 20:03:35,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:35,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:35,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. after waiting 0 ms 2023-02-13 20:03:35,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:35,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=01673b1d44e4ba19d57c597c9c938de1, UNASSIGN in 210 msec 2023-02-13 20:03:35,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:35,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:35,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688. 2023-02-13 20:03:35,827 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bd2aba78ec49b2dd0a3179c4fdffb688: Waiting for close lock at 1676318615788Running coprocessor pre-close hooks at 1676318615788Disabling compacts and flushes for region at 1676318615788Disabling writes for close at 1676318615788Writing region close event to WAL at 1676318615819 (+31 ms)Running coprocessor post-close hooks at 1676318615826 (+7 ms)Closed at 1676318615827 (+1 ms) 2023-02-13 20:03:35,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143. 2023-02-13 20:03:35,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c019ce0ac50892e0e02cf665fd9a0143: Waiting for close lock at 1676318615789Running coprocessor pre-close hooks at 1676318615789Disabling compacts and flushes for region at 1676318615789Disabling writes for close at 1676318615789Writing region close event to WAL at 1676318615820 (+31 ms)Running coprocessor post-close hooks at 1676318615827 (+7 ms)Closed at 1676318615828 (+1 ms) 2023-02-13 20:03:35,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:35,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:35,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1ff46d3cf47a857c973f635fc585aaa5, disabling compactions & flushes 2023-02-13 20:03:35,830 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:35,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:35,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. after waiting 0 ms 2023-02-13 20:03:35,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:35,831 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=bd2aba78ec49b2dd0a3179c4fdffb688, regionState=CLOSED 2023-02-13 20:03:35,831 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318615831"}]},"ts":"1676318615831"} 2023-02-13 20:03:35,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:35,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:35,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0038ac322ee5c7e7ad5ddc9e194eb8bd, disabling compactions & flushes 2023-02-13 20:03:35,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:35,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:35,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. after waiting 0 ms 2023-02-13 20:03:35,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:35,835 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c019ce0ac50892e0e02cf665fd9a0143, regionState=CLOSED 2023-02-13 20:03:35,835 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615835"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318615835"}]},"ts":"1676318615835"} 2023-02-13 20:03:35,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=40 2023-02-13 20:03:35,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=40, state=SUCCESS; CloseRegionProcedure bd2aba78ec49b2dd0a3179c4fdffb688, server=jenkins-hbase4.apache.org,41557,1676318604730 in 236 msec 2023-02-13 20:03:35,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bd2aba78ec49b2dd0a3179c4fdffb688, UNASSIGN in 271 msec 2023-02-13 20:03:35,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=36 2023-02-13 20:03:35,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=36, state=SUCCESS; CloseRegionProcedure c019ce0ac50892e0e02cf665fd9a0143, server=jenkins-hbase4.apache.org,44139,1676318604684 in 220 msec 2023-02-13 20:03:35,853 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c019ce0ac50892e0e02cf665fd9a0143, UNASSIGN in 274 msec 2023-02-13 20:03:35,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 20:03:35,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd. 2023-02-13 20:03:35,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0038ac322ee5c7e7ad5ddc9e194eb8bd: Waiting for close lock at 1676318615832Running coprocessor pre-close hooks at 1676318615832Disabling compacts and flushes for region at 1676318615832Disabling writes for close at 1676318615832Writing region close event to WAL at 1676318615848 (+16 ms)Running coprocessor post-close hooks at 1676318615862 (+14 ms)Closed at 1676318615865 (+3 ms) 2023-02-13 20:03:35,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:35,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:35,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a3484f1c6de9066fea0153c5227abc4d, disabling compactions & flushes 2023-02-13 20:03:35,868 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0038ac322ee5c7e7ad5ddc9e194eb8bd, regionState=CLOSED 2023-02-13 20:03:35,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:35,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:35,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. after waiting 0 ms 2023-02-13 20:03:35,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:35,868 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318615868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318615868"}]},"ts":"1676318615868"} 2023-02-13 20:03:35,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 20:03:35,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-02-13 20:03:35,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; CloseRegionProcedure 0038ac322ee5c7e7ad5ddc9e194eb8bd, server=jenkins-hbase4.apache.org,44139,1676318604684 in 274 msec 2023-02-13 20:03:35,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0038ac322ee5c7e7ad5ddc9e194eb8bd, UNASSIGN in 295 msec 2023-02-13 20:03:35,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:35,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5. 2023-02-13 20:03:35,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1ff46d3cf47a857c973f635fc585aaa5: Waiting for close lock at 1676318615830Running coprocessor pre-close hooks at 1676318615830Disabling compacts and flushes for region at 1676318615830Disabling writes for close at 1676318615830Writing region close event to WAL at 1676318615865 (+35 ms)Running coprocessor post-close hooks at 1676318615886 (+21 ms)Closed at 1676318615887 (+1 ms) 2023-02-13 20:03:35,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:35,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:35,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing aa4d100449bf1790cfc36baed2d7590e, disabling compactions & flushes 2023-02-13 20:03:35,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:35,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:35,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. after waiting 0 ms 2023-02-13 20:03:35,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:35,891 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=1ff46d3cf47a857c973f635fc585aaa5, regionState=CLOSED 2023-02-13 20:03:35,891 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615891"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318615891"}]},"ts":"1676318615891"} 2023-02-13 20:03:35,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=35 2023-02-13 20:03:35,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=35, state=SUCCESS; CloseRegionProcedure 1ff46d3cf47a857c973f635fc585aaa5, server=jenkins-hbase4.apache.org,41557,1676318604730 in 283 msec 2023-02-13 20:03:35,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1ff46d3cf47a857c973f635fc585aaa5, UNASSIGN in 320 msec 2023-02-13 20:03:35,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:35,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d. 2023-02-13 20:03:35,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a3484f1c6de9066fea0153c5227abc4d: Waiting for close lock at 1676318615868Running coprocessor pre-close hooks at 1676318615868Disabling compacts and flushes for region at 1676318615868Disabling writes for close at 1676318615868Writing region close event to WAL at 1676318615886 (+18 ms)Running coprocessor post-close hooks at 1676318615905 (+19 ms)Closed at 1676318615906 (+1 ms) 2023-02-13 20:03:35,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:35,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:35,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5eb2493284fd88bd0910d9c16859ca83, disabling compactions & flushes 2023-02-13 20:03:35,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:35,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:35,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. after waiting 1 ms 2023-02-13 20:03:35,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:35,909 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a3484f1c6de9066fea0153c5227abc4d, regionState=CLOSED 2023-02-13 20:03:35,909 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615909"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318615909"}]},"ts":"1676318615909"} 2023-02-13 20:03:35,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:35,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e. 2023-02-13 20:03:35,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for aa4d100449bf1790cfc36baed2d7590e: Waiting for close lock at 1676318615891Running coprocessor pre-close hooks at 1676318615891Disabling compacts and flushes for region at 1676318615891Disabling writes for close at 1676318615891Writing region close event to WAL at 1676318615904 (+13 ms)Running coprocessor post-close hooks at 1676318615911 (+7 ms)Closed at 1676318615912 (+1 ms) 2023-02-13 20:03:35,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:35,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:35,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8d2a9d00d13ed0d8081a57d0c816058f, disabling compactions & flushes 2023-02-13 20:03:35,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:35,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:35,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. after waiting 0 ms 2023-02-13 20:03:35,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:35,916 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=aa4d100449bf1790cfc36baed2d7590e, regionState=CLOSED 2023-02-13 20:03:35,916 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615916"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318615916"}]},"ts":"1676318615916"} 2023-02-13 20:03:35,917 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=37 2023-02-13 20:03:35,917 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=37, state=SUCCESS; CloseRegionProcedure a3484f1c6de9066fea0153c5227abc4d, server=jenkins-hbase4.apache.org,44139,1676318604684 in 300 msec 2023-02-13 20:03:35,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a3484f1c6de9066fea0153c5227abc4d, UNASSIGN in 340 msec 2023-02-13 20:03:35,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-13 20:03:35,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure aa4d100449bf1790cfc36baed2d7590e, server=jenkins-hbase4.apache.org,41557,1676318604730 in 310 msec 2023-02-13 20:03:35,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=aa4d100449bf1790cfc36baed2d7590e, UNASSIGN in 344 msec 2023-02-13 20:03:35,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:35,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83. 2023-02-13 20:03:35,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5eb2493284fd88bd0910d9c16859ca83: Waiting for close lock at 1676318615908Running coprocessor pre-close hooks at 1676318615908Disabling compacts and flushes for region at 1676318615908Disabling writes for close at 1676318615909 (+1 ms)Writing region close event to WAL at 1676318615911 (+2 ms)Running coprocessor post-close hooks at 1676318615925 (+14 ms)Closed at 1676318615928 (+3 ms) 2023-02-13 20:03:35,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:35,931 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=5eb2493284fd88bd0910d9c16859ca83, regionState=CLOSED 2023-02-13 20:03:35,931 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318615931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318615931"}]},"ts":"1676318615931"} 2023-02-13 20:03:35,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 20:03:35,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f. 2023-02-13 20:03:35,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8d2a9d00d13ed0d8081a57d0c816058f: Waiting for close lock at 1676318615915Running coprocessor pre-close hooks at 1676318615915Disabling compacts and flushes for region at 1676318615915Disabling writes for close at 1676318615915Writing region close event to WAL at 1676318615929 (+14 ms)Running coprocessor post-close hooks at 1676318615934 (+5 ms)Closed at 1676318615935 (+1 ms) 2023-02-13 20:03:35,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:35,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=42 2023-02-13 20:03:35,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=42, state=SUCCESS; CloseRegionProcedure 5eb2493284fd88bd0910d9c16859ca83, server=jenkins-hbase4.apache.org,44139,1676318604684 in 335 msec 2023-02-13 20:03:35,938 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=8d2a9d00d13ed0d8081a57d0c816058f, regionState=CLOSED 2023-02-13 20:03:35,938 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318615938"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318615938"}]},"ts":"1676318615938"} 2023-02-13 20:03:35,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5eb2493284fd88bd0910d9c16859ca83, UNASSIGN in 352 msec 2023-02-13 20:03:35,943 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-13 20:03:35,943 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 8d2a9d00d13ed0d8081a57d0c816058f, server=jenkins-hbase4.apache.org,41557,1676318604730 in 322 msec 2023-02-13 20:03:35,945 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=34, resume processing ppid=33 2023-02-13 20:03:35,945 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8d2a9d00d13ed0d8081a57d0c816058f, UNASSIGN in 367 msec 2023-02-13 20:03:35,946 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318615946"}]},"ts":"1676318615946"} 2023-02-13 20:03:35,948 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-13 20:03:35,950 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-13 20:03:35,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 390 msec 2023-02-13 20:03:36,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 20:03:36,177 INFO [Listener at localhost/39331] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-13 20:03:36,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-13 20:03:36,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-13 20:03:36,192 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 20:03:36,194 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 20:03:36,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 20:03:36,212 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:36,212 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:36,213 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:36,213 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:36,213 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:36,213 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:36,213 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:36,214 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:36,220 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/recovered.edits] 2023-02-13 20:03:36,220 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/recovered.edits] 2023-02-13 20:03:36,220 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f/f1, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f/f2, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f/recovered.edits] 2023-02-13 20:03:36,220 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/recovered.edits] 2023-02-13 20:03:36,221 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/recovered.edits] 2023-02-13 20:03:36,221 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/recovered.edits] 2023-02-13 20:03:36,224 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/recovered.edits] 2023-02-13 20:03:36,225 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/recovered.edits] 2023-02-13 20:03:36,234 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1/59381f230b8b4c7a8fd16eba1322f770 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1/59381f230b8b4c7a8fd16eba1322f770 2023-02-13 20:03:36,235 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1/1c0199bf67134ab8b47ccf02c90bba08 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1/1c0199bf67134ab8b47ccf02c90bba08 2023-02-13 20:03:36,235 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1/65b9486249c04a468f33ffda0fa5db15 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1/65b9486249c04a468f33ffda0fa5db15 2023-02-13 20:03:36,235 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1/1b722cc4b6c44e48a7bf7be2b7a8f546 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1/1b722cc4b6c44e48a7bf7be2b7a8f546 2023-02-13 20:03:36,236 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1/9e576719cc2d49359eb432a9d0a632f7 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1/9e576719cc2d49359eb432a9d0a632f7 2023-02-13 20:03:36,236 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1/05a01d5d337a44698001137fb9a20d00 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1/05a01d5d337a44698001137fb9a20d00 2023-02-13 20:03:36,236 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1/236e332551d14d18a9b1ebc27988ccb9 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1/236e332551d14d18a9b1ebc27988ccb9 2023-02-13 20:03:36,237 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f/recovered.edits/6.seqid to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f/recovered.edits/6.seqid 2023-02-13 20:03:36,239 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/8d2a9d00d13ed0d8081a57d0c816058f 2023-02-13 20:03:36,239 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:36,239 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1/6c2f8ef242984391b0afbf3c3371c450 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f1/6c2f8ef242984391b0afbf3c3371c450 2023-02-13 20:03:36,240 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1/4e0fab84fa454539b934c01fd02ab18f to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f1/4e0fab84fa454539b934c01fd02ab18f 2023-02-13 20:03:36,247 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1/f0e0ad5ce23e4785acd9dbd0d242e6d2 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f1/f0e0ad5ce23e4785acd9dbd0d242e6d2 2023-02-13 20:03:36,247 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1/a74f2083ec4d41c0b3ee85dce265cbf3 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f1/a74f2083ec4d41c0b3ee85dce265cbf3 2023-02-13 20:03:36,248 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1/c0ac94a31b28494f9a276c0e04a32f90 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f1/c0ac94a31b28494f9a276c0e04a32f90 2023-02-13 20:03:36,248 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1/1fe67ddc32d84b80add4b59bfa17c5d9 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f1/1fe67ddc32d84b80add4b59bfa17c5d9 2023-02-13 20:03:36,251 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1/9f327ba82b5940d5a4d11f7b7bb9bfe3 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f1/9f327ba82b5940d5a4d11f7b7bb9bfe3 2023-02-13 20:03:36,256 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/recovered.edits] 2023-02-13 20:03:36,259 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2/bf03ea3c163d44dca527f8323d695059 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2/bf03ea3c163d44dca527f8323d695059 2023-02-13 20:03:36,260 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2/74c9e7e9ca3d45adbb63c5757e235af8 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2/74c9e7e9ca3d45adbb63c5757e235af8 2023-02-13 20:03:36,260 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2/273f1a5311344becbfef1500bb405f83 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2/273f1a5311344becbfef1500bb405f83 2023-02-13 20:03:36,260 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2/8f7e2681e0a045edb6f9f02ecb2978a0 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2/8f7e2681e0a045edb6f9f02ecb2978a0 2023-02-13 20:03:36,261 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2/9634e0e0807c4270a9a016c4f7183449 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2/9634e0e0807c4270a9a016c4f7183449 2023-02-13 20:03:36,261 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2/2b748db97c1c4515a9c427c0b0d43764 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2/2b748db97c1c4515a9c427c0b0d43764 2023-02-13 20:03:36,262 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2/570aa99b4b8c4479b6936f156aa72632 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2/570aa99b4b8c4479b6936f156aa72632 2023-02-13 20:03:36,265 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2/60730c4a9f7948d9aa55253ba8608cc9 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/f2/60730c4a9f7948d9aa55253ba8608cc9 2023-02-13 20:03:36,265 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2/ee0d8e776f904b5c9cce7482af4e51ec to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/f2/ee0d8e776f904b5c9cce7482af4e51ec 2023-02-13 20:03:36,265 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2/c9af2b2428544fd0b21bfccd9890c44c to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/f2/c9af2b2428544fd0b21bfccd9890c44c 2023-02-13 20:03:36,266 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2/b5d24c3c637a425b97fb271435b7c6e4 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/f2/b5d24c3c637a425b97fb271435b7c6e4 2023-02-13 20:03:36,265 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2/a54a8877018f487bb88671a229bccabc to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/f2/a54a8877018f487bb88671a229bccabc 2023-02-13 20:03:36,266 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2/c87201e081b643c7b3a9c6f25ca04d66 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/f2/c87201e081b643c7b3a9c6f25ca04d66 2023-02-13 20:03:36,267 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2/ef2f9c064cb04729aee83933ec892a9d to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/f2/ef2f9c064cb04729aee83933ec892a9d 2023-02-13 20:03:36,269 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1/27a9c26d12d54d9f90787e6cf5fa3385 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1/27a9c26d12d54d9f90787e6cf5fa3385 2023-02-13 20:03:36,274 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1/6352d0a5f76042028f64137fb9fc9765 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f1/6352d0a5f76042028f64137fb9fc9765 2023-02-13 20:03:36,274 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/recovered.edits/12.seqid to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1/recovered.edits/12.seqid 2023-02-13 20:03:36,275 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/recovered.edits/12.seqid to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3/recovered.edits/12.seqid 2023-02-13 20:03:36,275 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/recovered.edits/12.seqid to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e/recovered.edits/12.seqid 2023-02-13 20:03:36,275 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/recovered.edits/12.seqid to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143/recovered.edits/12.seqid 2023-02-13 20:03:36,276 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/recovered.edits/12.seqid to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d/recovered.edits/12.seqid 2023-02-13 20:03:36,276 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/01673b1d44e4ba19d57c597c9c938de1 2023-02-13 20:03:36,276 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:36,277 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/40e615ba77a14f152f66739cced6b4f3 2023-02-13 20:03:36,278 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/aa4d100449bf1790cfc36baed2d7590e 2023-02-13 20:03:36,278 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/c019ce0ac50892e0e02cf665fd9a0143 2023-02-13 20:03:36,278 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/a3484f1c6de9066fea0153c5227abc4d 2023-02-13 20:03:36,278 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/recovered.edits/12.seqid to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5/recovered.edits/12.seqid 2023-02-13 20:03:36,279 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/recovered.edits/12.seqid to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688/recovered.edits/12.seqid 2023-02-13 20:03:36,279 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/1ff46d3cf47a857c973f635fc585aaa5 2023-02-13 20:03:36,280 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/bd2aba78ec49b2dd0a3179c4fdffb688 2023-02-13 20:03:36,281 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd/f1, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd/f2, FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd/recovered.edits] 2023-02-13 20:03:36,282 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2/059eb03071bf450eb92cb2f6724594cf to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2/059eb03071bf450eb92cb2f6724594cf 2023-02-13 20:03:36,285 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2/744dcf165ba44dea89de08fe9d973ac5 to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/f2/744dcf165ba44dea89de08fe9d973ac5 2023-02-13 20:03:36,289 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd/recovered.edits/6.seqid to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd/recovered.edits/6.seqid 2023-02-13 20:03:36,290 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/recovered.edits/12.seqid to hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/archive/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83/recovered.edits/12.seqid 2023-02-13 20:03:36,290 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/0038ac322ee5c7e7ad5ddc9e194eb8bd 2023-02-13 20:03:36,290 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/.tmp/data/default/testWithMapReduce/5eb2493284fd88bd0910d9c16859ca83 2023-02-13 20:03:36,291 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 20:03:36,294 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 20:03:36,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 20:03:36,326 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-13 20:03:36,330 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-13 20:03:36,332 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 20:03:36,332 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-13 20:03:36,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318616332"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:36,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318616332"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:36,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318616332"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:36,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318616332"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:36,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318616332"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:36,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318616332"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:36,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318616332"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:36,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318616332"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:36,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318616332"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:36,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318616332"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:36,335 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-13 20:03:36,335 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8d2a9d00d13ed0d8081a57d0c816058f, NAME => 'testWithMapReduce,,1676318608491.8d2a9d00d13ed0d8081a57d0c816058f.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 1ff46d3cf47a857c973f635fc585aaa5, NAME => 'testWithMapReduce,aaa,1676318608491.1ff46d3cf47a857c973f635fc585aaa5.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => c019ce0ac50892e0e02cf665fd9a0143, NAME => 'testWithMapReduce,d\x84\x84,1676318608491.c019ce0ac50892e0e02cf665fd9a0143.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => a3484f1c6de9066fea0153c5227abc4d, NAME => 'testWithMapReduce,g\xA7\xA7,1676318608491.a3484f1c6de9066fea0153c5227abc4d.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => aa4d100449bf1790cfc36baed2d7590e, NAME => 'testWithMapReduce,j\xCA\xCA,1676318608491.aa4d100449bf1790cfc36baed2d7590e.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 01673b1d44e4ba19d57c597c9c938de1, NAME => 'testWithMapReduce,m\xED\xED,1676318608491.01673b1d44e4ba19d57c597c9c938de1.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => bd2aba78ec49b2dd0a3179c4fdffb688, NAME => 'testWithMapReduce,q\x11\x10,1676318608491.bd2aba78ec49b2dd0a3179c4fdffb688.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 40e615ba77a14f152f66739cced6b4f3, NAME => 'testWithMapReduce,t43,1676318608491.40e615ba77a14f152f66739cced6b4f3.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 5eb2493284fd88bd0910d9c16859ca83, NAME => 'testWithMapReduce,wWV,1676318608491.5eb2493284fd88bd0910d9c16859ca83.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 0038ac322ee5c7e7ad5ddc9e194eb8bd, NAME => 'testWithMapReduce,zz{,1676318608491.0038ac322ee5c7e7ad5ddc9e194eb8bd.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-13 20:03:36,335 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-13 20:03:36,336 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676318616335"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:36,337 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-13 20:03:36,340 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 20:03:36,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 156 msec 2023-02-13 20:03:36,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39241] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 20:03:36,499 INFO [Listener at localhost/39331] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-13 20:03:36,499 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 20:03:36,500 INFO [Listener at localhost/39331] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 20:03:36,500 DEBUG [Listener at localhost/39331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ac00ad9 to 127.0.0.1:60561 2023-02-13 20:03:36,500 DEBUG [Listener at localhost/39331] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:36,500 DEBUG [Listener at localhost/39331] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 20:03:36,500 DEBUG [Listener at localhost/39331] util.JVMClusterUtil(257): Found active master hash=195877632, stopped=false 2023-02-13 20:03:36,500 INFO [Listener at localhost/39331] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39241,1676318603456 2023-02-13 20:03:36,504 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:36,504 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:36,504 INFO [Listener at localhost/39331] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 20:03:36,504 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:36,504 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:36,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:36,506 DEBUG [Listener at localhost/39331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x662a701b to 127.0.0.1:60561 2023-02-13 20:03:36,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:36,506 DEBUG [Listener at localhost/39331] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:36,507 INFO [Listener at localhost/39331] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44139,1676318604684' ***** 2023-02-13 20:03:36,507 INFO [Listener at localhost/39331] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:03:36,507 INFO [Listener at localhost/39331] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41557,1676318604730' ***** 2023-02-13 20:03:36,507 INFO [Listener at localhost/39331] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:03:36,507 INFO [RS:0;jenkins-hbase4:44139] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:03:36,507 INFO [RS:1;jenkins-hbase4:41557] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:03:36,507 INFO [RS:0;jenkins-hbase4:44139] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:03:36,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:36,507 INFO [RS:0;jenkins-hbase4:44139] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:03:36,507 INFO [RS:1;jenkins-hbase4:41557] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:03:36,507 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:03:36,508 INFO [RS:1;jenkins-hbase4:41557] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:03:36,508 INFO [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:36,507 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:03:36,508 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(3304): Received CLOSE for cd72c71a44411ee025dccd57b28ace46 2023-02-13 20:03:36,508 DEBUG [RS:0;jenkins-hbase4:44139] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c0fab1e to 127.0.0.1:60561 2023-02-13 20:03:36,509 DEBUG [RS:0;jenkins-hbase4:44139] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:36,510 INFO [RS:0;jenkins-hbase4:44139] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:03:36,510 INFO [RS:0;jenkins-hbase4:44139] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:03:36,510 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:36,510 INFO [RS:0;jenkins-hbase4:44139] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:03:36,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cd72c71a44411ee025dccd57b28ace46, disabling compactions & flushes 2023-02-13 20:03:36,510 INFO [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 20:03:36,510 DEBUG [RS:1;jenkins-hbase4:41557] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bbfea63 to 127.0.0.1:60561 2023-02-13 20:03:36,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. 2023-02-13 20:03:36,510 DEBUG [RS:1;jenkins-hbase4:41557] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:36,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. 2023-02-13 20:03:36,511 INFO [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 20:03:36,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. after waiting 0 ms 2023-02-13 20:03:36,511 DEBUG [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 20:03:36,511 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 20:03:36,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. 2023-02-13 20:03:36,511 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1479): Online Regions={cd72c71a44411ee025dccd57b28ace46=hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46.} 2023-02-13 20:03:36,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing cd72c71a44411ee025dccd57b28ace46 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 20:03:36,513 DEBUG [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 20:03:36,513 DEBUG [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1505): Waiting on cd72c71a44411ee025dccd57b28ace46 2023-02-13 20:03:36,513 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:03:36,513 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:03:36,513 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:03:36,513 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:03:36,513 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:03:36,513 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-13 20:03:36,580 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/.tmp/info/bb8a5f2bdc1040a0991ea4bfe4096264 2023-02-13 20:03:36,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/namespace/cd72c71a44411ee025dccd57b28ace46/.tmp/info/b775bc447b8b4bffa8e8cddd780fa36b 2023-02-13 20:03:36,590 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb8a5f2bdc1040a0991ea4bfe4096264 2023-02-13 20:03:36,592 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:36,593 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:36,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/namespace/cd72c71a44411ee025dccd57b28ace46/.tmp/info/b775bc447b8b4bffa8e8cddd780fa36b as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/namespace/cd72c71a44411ee025dccd57b28ace46/info/b775bc447b8b4bffa8e8cddd780fa36b 2023-02-13 20:03:36,624 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/namespace/cd72c71a44411ee025dccd57b28ace46/info/b775bc447b8b4bffa8e8cddd780fa36b, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 20:03:36,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cd72c71a44411ee025dccd57b28ace46 in 114ms, sequenceid=6, compaction requested=false 2023-02-13 20:03:36,657 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/.tmp/rep_barrier/2b95f5c0723c4499af055c88ebf3175d 2023-02-13 20:03:36,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/namespace/cd72c71a44411ee025dccd57b28ace46/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 20:03:36,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. 2023-02-13 20:03:36,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cd72c71a44411ee025dccd57b28ace46: Waiting for close lock at 1676318616510Running coprocessor pre-close hooks at 1676318616510Disabling compacts and flushes for region at 1676318616510Disabling writes for close at 1676318616511 (+1 ms)Obtaining lock to block concurrent updates at 1676318616511Preparing flush snapshotting stores in cd72c71a44411ee025dccd57b28ace46 at 1676318616511Finished memstore snapshotting hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676318616512 (+1 ms)Flushing stores of hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. at 1676318616513 (+1 ms)Flushing cd72c71a44411ee025dccd57b28ace46/info: creating writer at 1676318616513Flushing cd72c71a44411ee025dccd57b28ace46/info: appending metadata at 1676318616517 (+4 ms)Flushing cd72c71a44411ee025dccd57b28ace46/info: closing flushed file at 1676318616517Flushing cd72c71a44411ee025dccd57b28ace46/info: reopening flushed file at 1676318616595 (+78 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for cd72c71a44411ee025dccd57b28ace46 in 114ms, sequenceid=6, compaction requested=false at 1676318616626 (+31 ms)Writing region close event to WAL at 1676318616655 (+29 ms)Running coprocessor post-close hooks at 1676318616661 (+6 ms)Closed at 1676318616662 (+1 ms) 2023-02-13 20:03:36,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676318607593.cd72c71a44411ee025dccd57b28ace46. 2023-02-13 20:03:36,665 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b95f5c0723c4499af055c88ebf3175d 2023-02-13 20:03:36,681 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/.tmp/table/e4ef7205fae344f6ba40ee0658fa7dd0 2023-02-13 20:03:36,687 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4ef7205fae344f6ba40ee0658fa7dd0 2023-02-13 20:03:36,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/.tmp/info/bb8a5f2bdc1040a0991ea4bfe4096264 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/info/bb8a5f2bdc1040a0991ea4bfe4096264 2023-02-13 20:03:36,697 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb8a5f2bdc1040a0991ea4bfe4096264 2023-02-13 20:03:36,697 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/info/bb8a5f2bdc1040a0991ea4bfe4096264, entries=30, sequenceid=57, filesize=7.9 K 2023-02-13 20:03:36,698 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/.tmp/rep_barrier/2b95f5c0723c4499af055c88ebf3175d as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/rep_barrier/2b95f5c0723c4499af055c88ebf3175d 2023-02-13 20:03:36,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b95f5c0723c4499af055c88ebf3175d 2023-02-13 20:03:36,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/rep_barrier/2b95f5c0723c4499af055c88ebf3175d, entries=10, sequenceid=57, filesize=5.9 K 2023-02-13 20:03:36,705 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/.tmp/table/e4ef7205fae344f6ba40ee0658fa7dd0 as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/table/e4ef7205fae344f6ba40ee0658fa7dd0 2023-02-13 20:03:36,712 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4ef7205fae344f6ba40ee0658fa7dd0 2023-02-13 20:03:36,712 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/table/e4ef7205fae344f6ba40ee0658fa7dd0, entries=13, sequenceid=57, filesize=5.9 K 2023-02-13 20:03:36,713 DEBUG [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 20:03:36,713 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41557,1676318604730; all regions closed. 2023-02-13 20:03:36,713 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 200ms, sequenceid=57, compaction requested=false 2023-02-13 20:03:36,725 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-13 20:03:36,726 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 20:03:36,727 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:03:36,727 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318616511Running coprocessor pre-close hooks at 1676318616511Disabling compacts and flushes for region at 1676318616511Disabling writes for close at 1676318616513 (+2 ms)Obtaining lock to block concurrent updates at 1676318616513Preparing flush snapshotting stores in 1588230740 at 1676318616513Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676318616514 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676318616514Flushing 1588230740/info: creating writer at 1676318616514Flushing 1588230740/info: appending metadata at 1676318616520 (+6 ms)Flushing 1588230740/info: closing flushed file at 1676318616520Flushing 1588230740/rep_barrier: creating writer at 1676318616591 (+71 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676318616600 (+9 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676318616600Flushing 1588230740/table: creating writer at 1676318616665 (+65 ms)Flushing 1588230740/table: appending metadata at 1676318616668 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676318616668Flushing 1588230740/info: reopening flushed file at 1676318616689 (+21 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676318616698 (+9 ms)Flushing 1588230740/table: reopening flushed file at 1676318616706 (+8 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 200ms, sequenceid=57, compaction requested=false at 1676318616713 (+7 ms)Writing region close event to WAL at 1676318616721 (+8 ms)Running coprocessor post-close hooks at 1676318616726 (+5 ms)Closed at 1676318616727 (+1 ms) 2023-02-13 20:03:36,727 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 20:03:36,730 DEBUG [RS:1;jenkins-hbase4:41557] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/oldWALs 2023-02-13 20:03:36,730 INFO [RS:1;jenkins-hbase4:41557] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41557%2C1676318604730:(num 1676318608103) 2023-02-13 20:03:36,730 DEBUG [RS:1;jenkins-hbase4:41557] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:36,731 INFO [RS:1;jenkins-hbase4:41557] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:36,731 INFO [RS:1;jenkins-hbase4:41557] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 20:03:36,731 INFO [RS:1;jenkins-hbase4:41557] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:03:36,731 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:03:36,731 INFO [RS:1;jenkins-hbase4:41557] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:03:36,731 INFO [RS:1;jenkins-hbase4:41557] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:03:36,732 INFO [RS:1;jenkins-hbase4:41557] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41557 2023-02-13 20:03:36,740 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:36,740 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41557,1676318604730 2023-02-13 20:03:36,740 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:36,741 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:36,741 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:36,741 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@64128ab6 rejected from java.util.concurrent.ThreadPoolExecutor@602d02ec[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:36,743 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41557,1676318604730] 2023-02-13 20:03:36,743 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41557,1676318604730; numProcessing=1 2023-02-13 20:03:36,744 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41557,1676318604730 already deleted, retry=false 2023-02-13 20:03:36,744 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41557,1676318604730 expired; onlineServers=1 2023-02-13 20:03:36,843 INFO [RS:1;jenkins-hbase4:41557] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41557,1676318604730; zookeeper connection closed. 2023-02-13 20:03:36,843 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:36,843 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@64f7943d rejected from java.util.concurrent.ThreadPoolExecutor@602d02ec[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:36,843 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@705226dd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@705226dd 2023-02-13 20:03:36,843 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:41557-0x1004f47defe0002, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:36,843 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1c72af29 rejected from java.util.concurrent.ThreadPoolExecutor@602d02ec[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:36,913 INFO [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44139,1676318604684; all regions closed. 2023-02-13 20:03:36,919 DEBUG [RS:0;jenkins-hbase4:44139] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/oldWALs 2023-02-13 20:03:36,919 INFO [RS:0;jenkins-hbase4:44139] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44139%2C1676318604684.meta:.meta(num 1676318607324) 2023-02-13 20:03:36,925 DEBUG [RS:0;jenkins-hbase4:44139] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/oldWALs 2023-02-13 20:03:36,926 INFO [RS:0;jenkins-hbase4:44139] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44139%2C1676318604684:(num 1676318608121) 2023-02-13 20:03:36,926 DEBUG [RS:0;jenkins-hbase4:44139] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:36,926 INFO [RS:0;jenkins-hbase4:44139] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:36,926 INFO [RS:0;jenkins-hbase4:44139] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 20:03:36,927 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:03:36,928 INFO [RS:0;jenkins-hbase4:44139] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44139 2023-02-13 20:03:36,930 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:36,930 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44139,1676318604684 2023-02-13 20:03:36,930 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6adf82dc rejected from java.util.concurrent.ThreadPoolExecutor@6ee01b5f[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:36,933 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44139,1676318604684] 2023-02-13 20:03:36,933 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44139,1676318604684; numProcessing=2 2023-02-13 20:03:36,934 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44139,1676318604684 already deleted, retry=false 2023-02-13 20:03:36,934 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44139,1676318604684 expired; onlineServers=0 2023-02-13 20:03:36,935 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39241,1676318603456' ***** 2023-02-13 20:03:36,935 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 20:03:36,935 DEBUG [M:0;jenkins-hbase4:39241] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a91d13b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:03:36,935 INFO [M:0;jenkins-hbase4:39241] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39241,1676318603456 2023-02-13 20:03:36,935 INFO [M:0;jenkins-hbase4:39241] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39241,1676318603456; all regions closed. 2023-02-13 20:03:36,935 DEBUG [M:0;jenkins-hbase4:39241] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:36,936 DEBUG [M:0;jenkins-hbase4:39241] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 20:03:36,936 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 20:03:36,936 DEBUG [M:0;jenkins-hbase4:39241] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 20:03:36,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318605924] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318605924,5,FailOnTimeoutGroup] 2023-02-13 20:03:36,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318605924] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318605924,5,FailOnTimeoutGroup] 2023-02-13 20:03:36,937 INFO [M:0;jenkins-hbase4:39241] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 20:03:36,938 INFO [M:0;jenkins-hbase4:39241] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 20:03:36,938 INFO [M:0;jenkins-hbase4:39241] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 20:03:36,939 DEBUG [M:0;jenkins-hbase4:39241] master.HMaster(1502): Stopping service threads 2023-02-13 20:03:36,939 INFO [M:0;jenkins-hbase4:39241] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 20:03:36,939 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:36,939 ERROR [M:0;jenkins-hbase4:39241] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] 2023-02-13 20:03:36,939 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-13 20:03:36,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:36,940 INFO [M:0;jenkins-hbase4:39241] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 20:03:36,940 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 20:03:36,946 DEBUG [M:0;jenkins-hbase4:39241] zookeeper.ZKUtil(398): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 20:03:36,946 WARN [M:0;jenkins-hbase4:39241] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 20:03:36,947 INFO [M:0;jenkins-hbase4:39241] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 20:03:36,947 INFO [M:0;jenkins-hbase4:39241] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 20:03:36,948 DEBUG [M:0;jenkins-hbase4:39241] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:03:36,948 INFO [M:0;jenkins-hbase4:39241] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:36,948 DEBUG [M:0;jenkins-hbase4:39241] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:36,948 DEBUG [M:0;jenkins-hbase4:39241] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:03:36,948 DEBUG [M:0;jenkins-hbase4:39241] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:36,948 INFO [M:0;jenkins-hbase4:39241] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.23 KB heapSize=192.16 KB 2023-02-13 20:03:36,975 INFO [M:0;jenkins-hbase4:39241] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.23 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d7b0eac0377d4e659436af67c208780c 2023-02-13 20:03:36,981 DEBUG [M:0;jenkins-hbase4:39241] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d7b0eac0377d4e659436af67c208780c as hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d7b0eac0377d4e659436af67c208780c 2023-02-13 20:03:36,986 INFO [M:0;jenkins-hbase4:39241] regionserver.HStore(1080): Added hdfs://localhost:36203/user/jenkins/test-data/fea1d386-e29a-756c-6868-681554b98f96/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d7b0eac0377d4e659436af67c208780c, entries=53, sequenceid=357, filesize=10.4 K 2023-02-13 20:03:36,987 INFO [M:0;jenkins-hbase4:39241] regionserver.HRegion(2947): Finished flush of dataSize ~159.23 KB/163052, heapSize ~192.14 KB/196752, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 38ms, sequenceid=357, compaction requested=false 2023-02-13 20:03:36,988 INFO [M:0;jenkins-hbase4:39241] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:36,988 DEBUG [M:0;jenkins-hbase4:39241] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318616947Disabling compacts and flushes for region at 1676318616947Disabling writes for close at 1676318616948 (+1 ms)Obtaining lock to block concurrent updates at 1676318616948Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676318616948Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163052, getHeapSize=196752, getOffHeapSize=0, getCellsCount=442 at 1676318616948Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676318616949 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676318616950 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676318616954 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676318616954Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676318616982 (+28 ms)Finished flush of dataSize ~159.23 KB/163052, heapSize ~192.14 KB/196752, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 38ms, sequenceid=357, compaction requested=false at 1676318616987 (+5 ms)Writing region close event to WAL at 1676318616988 (+1 ms)Closed at 1676318616988 2023-02-13 20:03:36,993 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:03:36,993 INFO [M:0;jenkins-hbase4:39241] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 20:03:36,993 INFO [M:0;jenkins-hbase4:39241] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39241 2023-02-13 20:03:36,996 DEBUG [M:0;jenkins-hbase4:39241] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39241,1676318603456 already deleted, retry=false 2023-02-13 20:03:37,033 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:37,033 INFO [RS:0;jenkins-hbase4:44139] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44139,1676318604684; zookeeper connection closed. 2023-02-13 20:03:37,033 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@cdc0cbc rejected from java.util.concurrent.ThreadPoolExecutor@6ee01b5f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:37,034 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@17bee087] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@17bee087 2023-02-13 20:03:37,034 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): regionserver:44139-0x1004f47defe0001, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:37,034 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74d77c65 rejected from java.util.concurrent.ThreadPoolExecutor@6ee01b5f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:37,035 INFO [Listener at localhost/39331] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 20:03:37,134 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:37,134 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@b106a56 rejected from java.util.concurrent.ThreadPoolExecutor@622804e5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:37,134 DEBUG [Listener at localhost/39331-EventThread] zookeeper.ZKWatcher(600): master:39241-0x1004f47defe0000, quorum=127.0.0.1:60561, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:37,134 ERROR [Listener at localhost/39331-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@534bc16f rejected from java.util.concurrent.ThreadPoolExecutor@622804e5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:37,134 INFO [M:0;jenkins-hbase4:39241] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39241,1676318603456; zookeeper connection closed. 2023-02-13 20:03:37,138 WARN [Listener at localhost/39331] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:03:37,206 INFO [Listener at localhost/39331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:03:37,311 WARN [BP-1339302592-172.31.14.131-1676318600054 heartbeating to localhost/127.0.0.1:36203] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 20:03:37,311 WARN [BP-1339302592-172.31.14.131-1676318600054 heartbeating to localhost/127.0.0.1:36203] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1339302592-172.31.14.131-1676318600054 (Datanode Uuid 7df4099f-e054-42f3-9b42-4e78fdb49ccd) service to localhost/127.0.0.1:36203 2023-02-13 20:03:37,312 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/cluster_7c69506b-0957-c1d7-85bd-d8f120766d1b/dfs/data/data3/current/BP-1339302592-172.31.14.131-1676318600054] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:03:37,313 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/cluster_7c69506b-0957-c1d7-85bd-d8f120766d1b/dfs/data/data4/current/BP-1339302592-172.31.14.131-1676318600054] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:03:37,314 WARN [Listener at localhost/39331] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:03:37,324 WARN [BP-1339302592-172.31.14.131-1676318600054 heartbeating to localhost/127.0.0.1:36203] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1339302592-172.31.14.131-1676318600054 (Datanode Uuid dc2dda6d-cf86-4de4-8687-b125e63263c8) service to localhost/127.0.0.1:36203 2023-02-13 20:03:37,329 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/cluster_7c69506b-0957-c1d7-85bd-d8f120766d1b/dfs/data/data1/current/BP-1339302592-172.31.14.131-1676318600054] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:03:37,329 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/cluster_7c69506b-0957-c1d7-85bd-d8f120766d1b/dfs/data/data2/current/BP-1339302592-172.31.14.131-1676318600054] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:03:37,330 INFO [Listener at localhost/39331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:03:37,466 INFO [Listener at localhost/39331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:03:37,596 INFO [Listener at localhost/39331] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 20:03:37,677 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 20:03:37,691 INFO [Listener at localhost/39331] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=102 (was 7) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/39331 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39241,1676318603456)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:36203 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:36203 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36203 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:36203 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:36203 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:36203 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:36203 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-3-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: ForkJoinPool-3-worker-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@2b1a8cf3 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=535 (was 242) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 150) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=1881 (was 2943) 2023-02-13 20:03:37,700 INFO [Listener at localhost/39331] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=102, OpenFileDescriptor=535, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=166, AvailableMemoryMB=1881 2023-02-13 20:03:37,711 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/hadoop.log.dir so I do NOT create it in target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22 2023-02-13 20:03:37,711 WARN [Listener at localhost/39331] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 20:03:37,711 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/hadoop.tmp.dir so I do NOT create it in target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22 2023-02-13 20:03:37,711 WARN [Listener at localhost/39331] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/adfeecbf-98fc-381e-1a64-7b80504e0366/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 20:03:37,711 DEBUG [Listener at localhost/39331] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22 2023-02-13 20:03:37,711 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 20:03:37,711 INFO [Listener at localhost/39331] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/cluster_80b8dad7-f7d9-3d13-e07b-24d1c80445c4, deleteOnExit=true 2023-02-13 20:03:37,711 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 20:03:37,711 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/test.cache.data in system properties and HBase conf 2023-02-13 20:03:37,711 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 20:03:37,712 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/hadoop.log.dir in system properties and HBase conf 2023-02-13 20:03:37,712 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 20:03:37,712 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 20:03:37,712 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 20:03:37,712 DEBUG [Listener at localhost/39331] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 20:03:37,712 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:03:37,712 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:03:37,712 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 20:03:37,713 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:03:37,713 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 20:03:37,713 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 20:03:37,713 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:03:37,713 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:03:37,713 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 20:03:37,713 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/nfs.dump.dir in system properties and HBase conf 2023-02-13 20:03:37,713 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/java.io.tmpdir in system properties and HBase conf 2023-02-13 20:03:37,713 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:03:37,713 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 20:03:37,713 INFO [Listener at localhost/39331] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 20:03:37,718 WARN [Listener at localhost/39331] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:03:37,718 WARN [Listener at localhost/39331] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:03:37,802 WARN [Listener at localhost/39331] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:03:37,805 INFO [Listener at localhost/39331] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:03:37,809 INFO [Listener at localhost/39331] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/java.io.tmpdir/Jetty_localhost_33623_hdfs____.5ky3lr/webapp 2023-02-13 20:03:37,903 INFO [Listener at localhost/39331] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33623 2023-02-13 20:03:37,907 WARN [Listener at localhost/39331] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:03:37,907 WARN [Listener at localhost/39331] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:03:37,947 WARN [Listener at localhost/45203] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:03:37,963 WARN [Listener at localhost/45203] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:03:37,966 WARN [Listener at localhost/45203] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:03:37,967 INFO [Listener at localhost/45203] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:03:37,972 INFO [Listener at localhost/45203] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/java.io.tmpdir/Jetty_localhost_46481_datanode____.9j5jji/webapp 2023-02-13 20:03:38,063 INFO [Listener at localhost/45203] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46481 2023-02-13 20:03:38,070 WARN [Listener at localhost/34457] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:03:38,089 WARN [Listener at localhost/34457] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:03:38,092 WARN [Listener at localhost/34457] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:03:38,093 INFO [Listener at localhost/34457] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:03:38,096 INFO [Listener at localhost/34457] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/java.io.tmpdir/Jetty_localhost_36453_datanode____.gj9bt6/webapp 2023-02-13 20:03:38,192 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x629c23ef8632e51f: Processing first storage report for DS-2870d55b-fa56-4b04-a4e5-14d1e5c307e0 from datanode c8e7c5ba-4585-4512-8f38-9da8c74d06a3 2023-02-13 20:03:38,192 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x629c23ef8632e51f: from storage DS-2870d55b-fa56-4b04-a4e5-14d1e5c307e0 node DatanodeRegistration(127.0.0.1:36797, datanodeUuid=c8e7c5ba-4585-4512-8f38-9da8c74d06a3, infoPort=33935, infoSecurePort=0, ipcPort=34457, storageInfo=lv=-57;cid=testClusterID;nsid=753254670;c=1676318617720), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:38,193 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x629c23ef8632e51f: Processing first storage report for DS-d4824566-3d29-4536-87aa-26e93e7af651 from datanode c8e7c5ba-4585-4512-8f38-9da8c74d06a3 2023-02-13 20:03:38,193 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x629c23ef8632e51f: from storage DS-d4824566-3d29-4536-87aa-26e93e7af651 node DatanodeRegistration(127.0.0.1:36797, datanodeUuid=c8e7c5ba-4585-4512-8f38-9da8c74d06a3, infoPort=33935, infoSecurePort=0, ipcPort=34457, storageInfo=lv=-57;cid=testClusterID;nsid=753254670;c=1676318617720), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:38,203 INFO [Listener at localhost/34457] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36453 2023-02-13 20:03:38,213 WARN [Listener at localhost/35313] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:03:38,370 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe66670e0c97b495c: Processing first storage report for DS-85bd7c27-6423-4b66-904e-d40977896cd8 from datanode 46b3881a-9a2b-4ec2-b715-4d2ed09b4c34 2023-02-13 20:03:38,370 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe66670e0c97b495c: from storage DS-85bd7c27-6423-4b66-904e-d40977896cd8 node DatanodeRegistration(127.0.0.1:33379, datanodeUuid=46b3881a-9a2b-4ec2-b715-4d2ed09b4c34, infoPort=36513, infoSecurePort=0, ipcPort=35313, storageInfo=lv=-57;cid=testClusterID;nsid=753254670;c=1676318617720), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:38,370 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe66670e0c97b495c: Processing first storage report for DS-ddf358d3-5f53-4c7b-b388-e35fb529d901 from datanode 46b3881a-9a2b-4ec2-b715-4d2ed09b4c34 2023-02-13 20:03:38,370 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe66670e0c97b495c: from storage DS-ddf358d3-5f53-4c7b-b388-e35fb529d901 node DatanodeRegistration(127.0.0.1:33379, datanodeUuid=46b3881a-9a2b-4ec2-b715-4d2ed09b4c34, infoPort=36513, infoSecurePort=0, ipcPort=35313, storageInfo=lv=-57;cid=testClusterID;nsid=753254670;c=1676318617720), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:38,429 DEBUG [Listener at localhost/35313] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22 2023-02-13 20:03:38,432 INFO [Listener at localhost/35313] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/cluster_80b8dad7-f7d9-3d13-e07b-24d1c80445c4/zookeeper_0, clientPort=53275, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/cluster_80b8dad7-f7d9-3d13-e07b-24d1c80445c4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/cluster_80b8dad7-f7d9-3d13-e07b-24d1c80445c4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 20:03:38,434 INFO [Listener at localhost/35313] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53275 2023-02-13 20:03:38,434 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:38,436 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:38,455 INFO [Listener at localhost/35313] util.FSUtils(479): Created version file at hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8 with version=8 2023-02-13 20:03:38,455 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:38,457 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:38,458 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/hbase-staging 2023-02-13 20:03:38,460 INFO [Listener at localhost/35313] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:03:38,461 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:38,461 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:38,461 INFO [Listener at localhost/35313] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:03:38,461 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:38,461 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:03:38,461 INFO [Listener at localhost/35313] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:03:38,463 INFO [Listener at localhost/35313] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39879 2023-02-13 20:03:38,464 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:38,465 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:38,466 INFO [Listener at localhost/35313] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39879 connecting to ZooKeeper ensemble=127.0.0.1:53275 2023-02-13 20:03:38,477 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:398790x0, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:03:38,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39879-0x1004f481d040000 connected 2023-02-13 20:03:38,497 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:38,497 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:38,498 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:03:38,500 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39879 2023-02-13 20:03:38,504 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39879 2023-02-13 20:03:38,505 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39879 2023-02-13 20:03:38,506 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39879 2023-02-13 20:03:38,506 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39879 2023-02-13 20:03:38,506 INFO [Listener at localhost/35313] master.HMaster(439): hbase.rootdir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8, hbase.cluster.distributed=false 2023-02-13 20:03:38,521 INFO [Listener at localhost/35313] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:03:38,521 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:38,522 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:38,522 INFO [Listener at localhost/35313] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:03:38,522 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:38,522 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:03:38,522 INFO [Listener at localhost/35313] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:03:38,526 INFO [Listener at localhost/35313] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34961 2023-02-13 20:03:38,527 INFO [Listener at localhost/35313] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:03:38,528 DEBUG [Listener at localhost/35313] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:38,528 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:38,530 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:38,531 INFO [Listener at localhost/35313] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34961 connecting to ZooKeeper ensemble=127.0.0.1:53275 2023-02-13 20:03:38,535 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:349610x0, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:03:38,536 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): regionserver:349610x0, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:38,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34961-0x1004f481d040001 connected 2023-02-13 20:03:38,536 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:38,537 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:03:38,541 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34961 2023-02-13 20:03:38,544 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34961 2023-02-13 20:03:38,544 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34961 2023-02-13 20:03:38,545 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34961 2023-02-13 20:03:38,546 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34961 2023-02-13 20:03:38,566 INFO [Listener at localhost/35313] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:03:38,566 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:38,566 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:38,566 INFO [Listener at localhost/35313] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:03:38,567 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:38,567 INFO [Listener at localhost/35313] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:03:38,567 INFO [Listener at localhost/35313] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:03:38,569 INFO [Listener at localhost/35313] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34825 2023-02-13 20:03:38,569 INFO [Listener at localhost/35313] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:03:38,572 DEBUG [Listener at localhost/35313] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:38,572 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:38,574 INFO [Listener at localhost/35313] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:38,575 INFO [Listener at localhost/35313] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34825 connecting to ZooKeeper ensemble=127.0.0.1:53275 2023-02-13 20:03:38,582 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:348250x0, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:03:38,583 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): regionserver:348250x0, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:38,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34825-0x1004f481d040002 connected 2023-02-13 20:03:38,584 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:38,584 DEBUG [Listener at localhost/35313] zookeeper.ZKUtil(164): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:03:38,585 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34825 2023-02-13 20:03:38,588 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34825 2023-02-13 20:03:38,588 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34825 2023-02-13 20:03:38,588 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34825 2023-02-13 20:03:38,589 DEBUG [Listener at localhost/35313] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34825 2023-02-13 20:03:38,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39879,1676318618460 2023-02-13 20:03:38,593 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:03:38,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39879,1676318618460 2023-02-13 20:03:38,594 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:38,594 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:38,595 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:38,596 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:38,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:03:38,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39879,1676318618460 from backup master directory 2023-02-13 20:03:38,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:03:38,598 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39879,1676318618460 2023-02-13 20:03:38,598 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:03:38,598 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:03:38,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,39879,1676318618460 2023-02-13 20:03:38,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/hbase.id with ID: acebbfd9-71b9-4990-81bb-a7d81e2e0738 2023-02-13 20:03:38,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:38,632 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:38,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x53b70a7d to 127.0.0.1:53275 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:38,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2914b98b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:38,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:38,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 20:03:38,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:38,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/MasterData/data/master/store-tmp 2023-02-13 20:03:38,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:38,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:03:38,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:38,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:38,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:03:38,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:38,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:38,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318618666Disabling compacts and flushes for region at 1676318618666Disabling writes for close at 1676318618666Writing region close event to WAL at 1676318618666Closed at 1676318618666 2023-02-13 20:03:38,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/MasterData/WALs/jenkins-hbase4.apache.org,39879,1676318618460 2023-02-13 20:03:38,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39879%2C1676318618460, suffix=, logDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/MasterData/WALs/jenkins-hbase4.apache.org,39879,1676318618460, archiveDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/MasterData/oldWALs, maxLogs=10 2023-02-13 20:03:38,692 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36797,DS-2870d55b-fa56-4b04-a4e5-14d1e5c307e0,DISK] 2023-02-13 20:03:38,692 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33379,DS-85bd7c27-6423-4b66-904e-d40977896cd8,DISK] 2023-02-13 20:03:38,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/MasterData/WALs/jenkins-hbase4.apache.org,39879,1676318618460/jenkins-hbase4.apache.org%2C39879%2C1676318618460.1676318618670 2023-02-13 20:03:38,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36797,DS-2870d55b-fa56-4b04-a4e5-14d1e5c307e0,DISK], DatanodeInfoWithStorage[127.0.0.1:33379,DS-85bd7c27-6423-4b66-904e-d40977896cd8,DISK]] 2023-02-13 20:03:38,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:03:38,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:38,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:38,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:38,697 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:38,698 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 20:03:38,699 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 20:03:38,699 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:38,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:38,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:38,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:38,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:38,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67576839, jitterRate=0.006973370909690857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:03:38,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676318618696Initializing all the Stores at 1676318618696Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318618697 (+1 ms)Cleaning up temporary data from old regions at 1676318618701 (+4 ms)Cleaning up detritus from prior splits at 1676318618701Region opened successfully at 1676318618706 (+5 ms) 2023-02-13 20:03:38,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 20:03:38,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 20:03:38,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 20:03:38,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 20:03:38,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 20:03:38,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 20:03:38,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 20:03:38,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 20:03:38,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 20:03:38,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 20:03:38,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 20:03:38,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 20:03:38,724 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 20:03:38,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 20:03:38,726 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:38,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 20:03:38,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 20:03:38,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 20:03:38,729 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:38,729 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:38,729 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:38,729 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:38,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,39879,1676318618460, sessionid=0x1004f481d040000, setting cluster-up flag (Was=false) 2023-02-13 20:03:38,741 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:38,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 20:03:38,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39879,1676318618460 2023-02-13 20:03:38,750 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:38,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 20:03:38,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39879,1676318618460 2023-02-13 20:03:38,757 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.hbase-snapshot/.tmp 2023-02-13 20:03:38,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 20:03:38,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:38,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:38,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:38,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:38,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 20:03:38,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:03:38,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676318648763 2023-02-13 20:03:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 20:03:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 20:03:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 20:03:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 20:03:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 20:03:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 20:03:38,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 20:03:38,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 20:03:38,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 20:03:38,764 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:03:38,764 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 20:03:38,766 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:38,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 20:03:38,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 20:03:38,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318618771,5,FailOnTimeoutGroup] 2023-02-13 20:03:38,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318618771,5,FailOnTimeoutGroup] 2023-02-13 20:03:38,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 20:03:38,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,782 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:38,782 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:38,783 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8 2023-02-13 20:03:38,792 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:38,792 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(952): ClusterId : acebbfd9-71b9-4990-81bb-a7d81e2e0738 2023-02-13 20:03:38,792 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(952): ClusterId : acebbfd9-71b9-4990-81bb-a7d81e2e0738 2023-02-13 20:03:38,792 DEBUG [RS:0;jenkins-hbase4:34961] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:03:38,793 DEBUG [RS:1;jenkins-hbase4:34825] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:03:38,793 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:03:38,795 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/info 2023-02-13 20:03:38,795 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:03:38,796 DEBUG [RS:1;jenkins-hbase4:34825] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:03:38,796 DEBUG [RS:1;jenkins-hbase4:34825] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:03:38,796 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:38,796 DEBUG [RS:0;jenkins-hbase4:34961] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:03:38,796 DEBUG [RS:0;jenkins-hbase4:34961] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:03:38,796 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:03:38,798 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:03:38,798 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:03:38,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:38,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:03:38,800 DEBUG [RS:0;jenkins-hbase4:34961] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:03:38,800 DEBUG [RS:1;jenkins-hbase4:34825] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:03:38,803 DEBUG [RS:1;jenkins-hbase4:34825] zookeeper.ReadOnlyZKClient(139): Connect 0x5cc80f0d to 127.0.0.1:53275 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:38,803 DEBUG [RS:0;jenkins-hbase4:34961] zookeeper.ReadOnlyZKClient(139): Connect 0x791198c9 to 127.0.0.1:53275 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:38,803 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/table 2023-02-13 20:03:38,803 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:03:38,809 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:38,810 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740 2023-02-13 20:03:38,810 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740 2023-02-13 20:03:38,811 DEBUG [RS:0;jenkins-hbase4:34961] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77d6799b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:38,812 DEBUG [RS:0;jenkins-hbase4:34961] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73e9f3b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:03:38,812 DEBUG [RS:1;jenkins-hbase4:34825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@520feae4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:38,812 DEBUG [RS:1;jenkins-hbase4:34825] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5630647d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:03:38,813 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:03:38,814 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:03:38,816 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:38,816 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60601077, jitterRate=-0.09697358310222626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:03:38,816 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676318618792Initializing all the Stores at 1676318618793 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318618793Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318618793Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318618793Cleaning up temporary data from old regions at 1676318618811 (+18 ms)Cleaning up detritus from prior splits at 1676318618812 (+1 ms)Region opened successfully at 1676318618816 (+4 ms) 2023-02-13 20:03:38,817 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:03:38,817 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:03:38,817 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:03:38,817 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:03:38,817 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:03:38,820 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:03:38,820 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318618817Disabling compacts and flushes for region at 1676318618817Disabling writes for close at 1676318618817Writing region close event to WAL at 1676318618820 (+3 ms)Closed at 1676318618820 2023-02-13 20:03:38,821 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:03:38,821 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 20:03:38,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 20:03:38,823 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 20:03:38,824 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 20:03:38,826 DEBUG [RS:0;jenkins-hbase4:34961] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34961 2023-02-13 20:03:38,826 DEBUG [RS:1;jenkins-hbase4:34825] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34825 2023-02-13 20:03:38,827 INFO [RS:0;jenkins-hbase4:34961] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:03:38,827 INFO [RS:0;jenkins-hbase4:34961] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:03:38,827 INFO [RS:1;jenkins-hbase4:34825] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:03:38,827 INFO [RS:1;jenkins-hbase4:34825] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:03:38,827 DEBUG [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:03:38,827 DEBUG [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:03:38,827 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39879,1676318618460 with isa=jenkins-hbase4.apache.org/172.31.14.131:34961, startcode=1676318618521 2023-02-13 20:03:38,827 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39879,1676318618460 with isa=jenkins-hbase4.apache.org/172.31.14.131:34825, startcode=1676318618565 2023-02-13 20:03:38,828 DEBUG [RS:0;jenkins-hbase4:34961] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:03:38,828 DEBUG [RS:1;jenkins-hbase4:34825] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:03:38,831 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52073, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:03:38,832 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47899, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:03:38,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39879] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:38,833 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:38,834 DEBUG [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8 2023-02-13 20:03:38,834 DEBUG [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45203 2023-02-13 20:03:38,834 DEBUG [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8 2023-02-13 20:03:38,834 DEBUG [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:03:38,834 DEBUG [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45203 2023-02-13 20:03:38,834 DEBUG [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:03:38,839 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:38,839 DEBUG [RS:1;jenkins-hbase4:34825] zookeeper.ZKUtil(162): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:38,840 WARN [RS:1;jenkins-hbase4:34825] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:03:38,840 INFO [RS:1;jenkins-hbase4:34825] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:38,840 DEBUG [RS:0;jenkins-hbase4:34961] zookeeper.ZKUtil(162): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:38,840 DEBUG [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/WALs/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:38,840 WARN [RS:0;jenkins-hbase4:34961] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:03:38,840 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34825,1676318618565] 2023-02-13 20:03:38,840 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34961,1676318618521] 2023-02-13 20:03:38,840 INFO [RS:0;jenkins-hbase4:34961] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:38,840 DEBUG [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/WALs/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:38,848 DEBUG [RS:1;jenkins-hbase4:34825] zookeeper.ZKUtil(162): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:38,848 DEBUG [RS:0;jenkins-hbase4:34961] zookeeper.ZKUtil(162): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:38,848 DEBUG [RS:1;jenkins-hbase4:34825] zookeeper.ZKUtil(162): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:38,848 DEBUG [RS:0;jenkins-hbase4:34961] zookeeper.ZKUtil(162): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:38,849 DEBUG [RS:1;jenkins-hbase4:34825] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:03:38,849 DEBUG [RS:0;jenkins-hbase4:34961] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:03:38,849 INFO [RS:1;jenkins-hbase4:34825] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:03:38,849 INFO [RS:0;jenkins-hbase4:34961] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:03:38,851 INFO [RS:1;jenkins-hbase4:34825] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:03:38,852 INFO [RS:1;jenkins-hbase4:34825] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:03:38,852 INFO [RS:0;jenkins-hbase4:34961] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:03:38,852 INFO [RS:1;jenkins-hbase4:34825] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,856 INFO [RS:0;jenkins-hbase4:34961] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:03:38,856 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:03:38,856 INFO [RS:0;jenkins-hbase4:34961] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,857 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:03:38,858 INFO [RS:1;jenkins-hbase4:34825] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,858 INFO [RS:0;jenkins-hbase4:34961] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,858 DEBUG [RS:1;jenkins-hbase4:34825] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:0;jenkins-hbase4:34961] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:1;jenkins-hbase4:34825] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:0;jenkins-hbase4:34961] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:1;jenkins-hbase4:34825] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:0;jenkins-hbase4:34961] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:1;jenkins-hbase4:34825] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:0;jenkins-hbase4:34961] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:1;jenkins-hbase4:34825] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:0;jenkins-hbase4:34961] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:1;jenkins-hbase4:34825] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:03:38,858 DEBUG [RS:0;jenkins-hbase4:34961] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:03:38,858 DEBUG [RS:1;jenkins-hbase4:34825] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:0;jenkins-hbase4:34961] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:1;jenkins-hbase4:34825] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:0;jenkins-hbase4:34961] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,858 DEBUG [RS:1;jenkins-hbase4:34825] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,859 DEBUG [RS:0;jenkins-hbase4:34961] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,859 DEBUG [RS:1;jenkins-hbase4:34825] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,859 DEBUG [RS:0;jenkins-hbase4:34961] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:38,862 INFO [RS:1;jenkins-hbase4:34825] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,862 INFO [RS:0;jenkins-hbase4:34961] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,862 INFO [RS:1;jenkins-hbase4:34825] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,862 INFO [RS:0;jenkins-hbase4:34961] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,862 INFO [RS:1;jenkins-hbase4:34825] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,862 INFO [RS:0;jenkins-hbase4:34961] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,877 INFO [RS:1;jenkins-hbase4:34825] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:03:38,878 INFO [RS:1;jenkins-hbase4:34825] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34825,1676318618565-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,882 INFO [RS:0;jenkins-hbase4:34961] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:03:38,882 INFO [RS:0;jenkins-hbase4:34961] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34961,1676318618521-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:38,893 INFO [RS:1;jenkins-hbase4:34825] regionserver.Replication(203): jenkins-hbase4.apache.org,34825,1676318618565 started 2023-02-13 20:03:38,893 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34825,1676318618565, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34825, sessionid=0x1004f481d040002 2023-02-13 20:03:38,893 DEBUG [RS:1;jenkins-hbase4:34825] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:03:38,893 DEBUG [RS:1;jenkins-hbase4:34825] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:38,893 DEBUG [RS:1;jenkins-hbase4:34825] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34825,1676318618565' 2023-02-13 20:03:38,893 DEBUG [RS:1;jenkins-hbase4:34825] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:38,894 DEBUG [RS:1;jenkins-hbase4:34825] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:38,894 DEBUG [RS:1;jenkins-hbase4:34825] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:03:38,894 DEBUG [RS:1;jenkins-hbase4:34825] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:03:38,894 DEBUG [RS:1;jenkins-hbase4:34825] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:38,894 DEBUG [RS:1;jenkins-hbase4:34825] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34825,1676318618565' 2023-02-13 20:03:38,894 DEBUG [RS:1;jenkins-hbase4:34825] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:38,895 DEBUG [RS:1;jenkins-hbase4:34825] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:38,895 DEBUG [RS:1;jenkins-hbase4:34825] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:03:38,895 INFO [RS:1;jenkins-hbase4:34825] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:03:38,895 INFO [RS:1;jenkins-hbase4:34825] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:03:38,897 INFO [RS:0;jenkins-hbase4:34961] regionserver.Replication(203): jenkins-hbase4.apache.org,34961,1676318618521 started 2023-02-13 20:03:38,897 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34961,1676318618521, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34961, sessionid=0x1004f481d040001 2023-02-13 20:03:38,897 DEBUG [RS:0;jenkins-hbase4:34961] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:03:38,897 DEBUG [RS:0;jenkins-hbase4:34961] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:38,897 DEBUG [RS:0;jenkins-hbase4:34961] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34961,1676318618521' 2023-02-13 20:03:38,897 DEBUG [RS:0;jenkins-hbase4:34961] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:38,898 DEBUG [RS:0;jenkins-hbase4:34961] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:38,898 DEBUG [RS:0;jenkins-hbase4:34961] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:03:38,898 DEBUG [RS:0;jenkins-hbase4:34961] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:03:38,898 DEBUG [RS:0;jenkins-hbase4:34961] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:38,898 DEBUG [RS:0;jenkins-hbase4:34961] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34961,1676318618521' 2023-02-13 20:03:38,898 DEBUG [RS:0;jenkins-hbase4:34961] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:38,899 DEBUG [RS:0;jenkins-hbase4:34961] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:38,899 DEBUG [RS:0;jenkins-hbase4:34961] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:03:38,899 INFO [RS:0;jenkins-hbase4:34961] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:03:38,899 INFO [RS:0;jenkins-hbase4:34961] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:03:38,974 DEBUG [jenkins-hbase4:39879] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 20:03:38,975 DEBUG [jenkins-hbase4:39879] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:03:38,977 DEBUG [jenkins-hbase4:39879] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:03:38,977 DEBUG [jenkins-hbase4:39879] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:03:38,977 DEBUG [jenkins-hbase4:39879] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:03:38,978 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34961,1676318618521, state=OPENING 2023-02-13 20:03:38,979 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 20:03:38,981 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:38,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34961,1676318618521}] 2023-02-13 20:03:38,982 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:03:39,136 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:39,136 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 20:03:39,141 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49598, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 20:03:39,153 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 20:03:39,153 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:39,155 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34961%2C1676318618521.meta, suffix=.meta, logDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/WALs/jenkins-hbase4.apache.org,34961,1676318618521, archiveDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/oldWALs, maxLogs=32 2023-02-13 20:03:39,171 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36797,DS-2870d55b-fa56-4b04-a4e5-14d1e5c307e0,DISK] 2023-02-13 20:03:39,172 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33379,DS-85bd7c27-6423-4b66-904e-d40977896cd8,DISK] 2023-02-13 20:03:39,176 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/WALs/jenkins-hbase4.apache.org,34961,1676318618521/jenkins-hbase4.apache.org%2C34961%2C1676318618521.meta.1676318619156.meta 2023-02-13 20:03:39,180 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36797,DS-2870d55b-fa56-4b04-a4e5-14d1e5c307e0,DISK], DatanodeInfoWithStorage[127.0.0.1:33379,DS-85bd7c27-6423-4b66-904e-d40977896cd8,DISK]] 2023-02-13 20:03:39,180 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:03:39,180 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 20:03:39,180 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 20:03:39,181 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 20:03:39,181 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 20:03:39,181 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:39,181 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 20:03:39,181 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 20:03:39,188 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:03:39,189 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/info 2023-02-13 20:03:39,189 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/info 2023-02-13 20:03:39,190 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:03:39,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:39,191 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:03:39,192 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:03:39,192 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:03:39,192 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:03:39,193 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:39,193 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:03:39,194 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/table 2023-02-13 20:03:39,195 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/table 2023-02-13 20:03:39,195 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:03:39,196 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:39,196 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740 2023-02-13 20:03:39,197 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740 2023-02-13 20:03:39,199 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:03:39,201 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:03:39,202 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74710331, jitterRate=0.11327068507671356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:03:39,202 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676318619182Writing region info on filesystem at 1676318619182Initializing all the Stores at 1676318619188 (+6 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318619188Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318619188Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318619188Cleaning up temporary data from old regions at 1676318619198 (+10 ms)Cleaning up detritus from prior splits at 1676318619199 (+1 ms)Running coprocessor post-open hooks at 1676318619202 (+3 ms)Region opened successfully at 1676318619202 2023-02-13 20:03:39,203 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676318619136 2023-02-13 20:03:39,207 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 20:03:39,208 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 20:03:39,208 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34961,1676318618521, state=OPEN 2023-02-13 20:03:39,210 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 20:03:39,210 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:03:39,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 20:03:39,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34961,1676318618521 in 229 msec 2023-02-13 20:03:39,220 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 20:03:39,220 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 397 msec 2023-02-13 20:03:39,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 462 msec 2023-02-13 20:03:39,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676318618593, completionTime=-1 2023-02-13 20:03:39,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 20:03:39,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 20:03:39,226 DEBUG [hconnection-0x7657ee4f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:39,228 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49614, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:39,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 20:03:39,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676318679230 2023-02-13 20:03:39,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676318739230 2023-02-13 20:03:39,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 8 msec 2023-02-13 20:03:39,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39879,1676318618460-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:39,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39879,1676318618460-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:39,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39879,1676318618460-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:39,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39879, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:39,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:39,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 20:03:39,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:39,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 20:03:39,241 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:03:39,242 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:03:39,242 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 20:03:39,244 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/hbase/namespace/4fe124c6119a7f92bad9e653b24cb046 2023-02-13 20:03:39,244 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/hbase/namespace/4fe124c6119a7f92bad9e653b24cb046 empty. 2023-02-13 20:03:39,245 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/hbase/namespace/4fe124c6119a7f92bad9e653b24cb046 2023-02-13 20:03:39,245 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 20:03:39,274 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:39,275 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4fe124c6119a7f92bad9e653b24cb046, NAME => 'hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp 2023-02-13 20:03:39,302 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:39,302 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 4fe124c6119a7f92bad9e653b24cb046, disabling compactions & flushes 2023-02-13 20:03:39,302 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. 2023-02-13 20:03:39,302 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. 2023-02-13 20:03:39,302 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. after waiting 0 ms 2023-02-13 20:03:39,302 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. 2023-02-13 20:03:39,302 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. 2023-02-13 20:03:39,302 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 4fe124c6119a7f92bad9e653b24cb046: Waiting for close lock at 1676318619302Disabling compacts and flushes for region at 1676318619302Disabling writes for close at 1676318619302Writing region close event to WAL at 1676318619302Closed at 1676318619302 2023-02-13 20:03:39,307 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:03:39,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318619308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318619308"}]},"ts":"1676318619308"} 2023-02-13 20:03:39,312 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 20:03:39,313 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:03:39,314 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318619313"}]},"ts":"1676318619313"} 2023-02-13 20:03:39,315 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 20:03:39,320 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:03:39,321 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:03:39,321 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:03:39,321 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:03:39,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4fe124c6119a7f92bad9e653b24cb046, ASSIGN}] 2023-02-13 20:03:39,324 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4fe124c6119a7f92bad9e653b24cb046, ASSIGN 2023-02-13 20:03:39,325 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4fe124c6119a7f92bad9e653b24cb046, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34825,1676318618565; forceNewPlan=false, retain=false 2023-02-13 20:03:39,475 INFO [jenkins-hbase4:39879] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 20:03:39,476 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4fe124c6119a7f92bad9e653b24cb046, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:39,476 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318619476"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318619476"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318619476"}]},"ts":"1676318619476"} 2023-02-13 20:03:39,479 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4fe124c6119a7f92bad9e653b24cb046, server=jenkins-hbase4.apache.org,34825,1676318618565}] 2023-02-13 20:03:39,632 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:39,632 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 20:03:39,635 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36254, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 20:03:39,640 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. 2023-02-13 20:03:39,642 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34825%2C1676318618565, suffix=, logDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/WALs/jenkins-hbase4.apache.org,34825,1676318618565, archiveDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/oldWALs, maxLogs=32 2023-02-13 20:03:39,666 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33379,DS-85bd7c27-6423-4b66-904e-d40977896cd8,DISK] 2023-02-13 20:03:39,666 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36797,DS-2870d55b-fa56-4b04-a4e5-14d1e5c307e0,DISK] 2023-02-13 20:03:39,675 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/WALs/jenkins-hbase4.apache.org,34825,1676318618565/jenkins-hbase4.apache.org%2C34825%2C1676318618565.1676318619643 2023-02-13 20:03:39,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33379,DS-85bd7c27-6423-4b66-904e-d40977896cd8,DISK], DatanodeInfoWithStorage[127.0.0.1:36797,DS-2870d55b-fa56-4b04-a4e5-14d1e5c307e0,DISK]] 2023-02-13 20:03:39,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4fe124c6119a7f92bad9e653b24cb046, NAME => 'hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:03:39,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4fe124c6119a7f92bad9e653b24cb046 2023-02-13 20:03:39,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:39,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4fe124c6119a7f92bad9e653b24cb046 2023-02-13 20:03:39,676 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4fe124c6119a7f92bad9e653b24cb046 2023-02-13 20:03:39,680 INFO [StoreOpener-4fe124c6119a7f92bad9e653b24cb046-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4fe124c6119a7f92bad9e653b24cb046 2023-02-13 20:03:39,682 DEBUG [StoreOpener-4fe124c6119a7f92bad9e653b24cb046-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/namespace/4fe124c6119a7f92bad9e653b24cb046/info 2023-02-13 20:03:39,682 DEBUG [StoreOpener-4fe124c6119a7f92bad9e653b24cb046-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/namespace/4fe124c6119a7f92bad9e653b24cb046/info 2023-02-13 20:03:39,682 INFO [StoreOpener-4fe124c6119a7f92bad9e653b24cb046-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fe124c6119a7f92bad9e653b24cb046 columnFamilyName info 2023-02-13 20:03:39,683 INFO [StoreOpener-4fe124c6119a7f92bad9e653b24cb046-1] regionserver.HStore(310): Store=4fe124c6119a7f92bad9e653b24cb046/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:39,684 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/namespace/4fe124c6119a7f92bad9e653b24cb046 2023-02-13 20:03:39,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/namespace/4fe124c6119a7f92bad9e653b24cb046 2023-02-13 20:03:39,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4fe124c6119a7f92bad9e653b24cb046 2023-02-13 20:03:39,698 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/namespace/4fe124c6119a7f92bad9e653b24cb046/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:39,698 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4fe124c6119a7f92bad9e653b24cb046; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70731934, jitterRate=0.05398795008659363}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:03:39,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4fe124c6119a7f92bad9e653b24cb046: Running coprocessor pre-open hook at 1676318619677Writing region info on filesystem at 1676318619677Initializing all the Stores at 1676318619678 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318619678Cleaning up temporary data from old regions at 1676318619688 (+10 ms)Cleaning up detritus from prior splits at 1676318619688Running coprocessor post-open hooks at 1676318619698 (+10 ms)Region opened successfully at 1676318619698 2023-02-13 20:03:39,700 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046., pid=6, masterSystemTime=1676318619632 2023-02-13 20:03:39,704 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. 2023-02-13 20:03:39,704 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. 2023-02-13 20:03:39,705 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4fe124c6119a7f92bad9e653b24cb046, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:39,705 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318619704"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318619704"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318619704"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318619704"}]},"ts":"1676318619704"} 2023-02-13 20:03:39,709 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 20:03:39,709 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4fe124c6119a7f92bad9e653b24cb046, server=jenkins-hbase4.apache.org,34825,1676318618565 in 228 msec 2023-02-13 20:03:39,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 20:03:39,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4fe124c6119a7f92bad9e653b24cb046, ASSIGN in 388 msec 2023-02-13 20:03:39,712 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:03:39,712 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318619712"}]},"ts":"1676318619712"} 2023-02-13 20:03:39,713 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 20:03:39,716 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:03:39,717 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 478 msec 2023-02-13 20:03:39,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 20:03:39,742 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:03:39,742 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:39,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:39,748 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36266, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:39,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 20:03:39,769 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:03:39,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 22 msec 2023-02-13 20:03:39,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 20:03:39,794 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:03:39,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 13 msec 2023-02-13 20:03:39,809 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 20:03:39,811 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 20:03:39,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.214sec 2023-02-13 20:03:39,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 20:03:39,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 20:03:39,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 20:03:39,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39879,1676318618460-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 20:03:39,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39879,1676318618460-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 20:03:39,817 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 20:03:39,893 DEBUG [Listener at localhost/35313] zookeeper.ReadOnlyZKClient(139): Connect 0x15b90c3a to 127.0.0.1:53275 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:39,901 INFO [RS:0;jenkins-hbase4:34961] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34961%2C1676318618521, suffix=, logDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/WALs/jenkins-hbase4.apache.org,34961,1676318618521, archiveDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/oldWALs, maxLogs=32 2023-02-13 20:03:39,921 DEBUG [Listener at localhost/35313] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74436896, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:39,930 DEBUG [hconnection-0x68572e05-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:39,942 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33379,DS-85bd7c27-6423-4b66-904e-d40977896cd8,DISK] 2023-02-13 20:03:39,942 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36797,DS-2870d55b-fa56-4b04-a4e5-14d1e5c307e0,DISK] 2023-02-13 20:03:39,945 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49630, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:39,951 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39879,1676318618460 2023-02-13 20:03:39,951 DEBUG [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 20:03:39,951 INFO [RS:0;jenkins-hbase4:34961] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/WALs/jenkins-hbase4.apache.org,34961,1676318618521/jenkins-hbase4.apache.org%2C34961%2C1676318618521.1676318619902 2023-02-13 20:03:39,956 DEBUG [RS:0;jenkins-hbase4:34961] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36797,DS-2870d55b-fa56-4b04-a4e5-14d1e5c307e0,DISK], DatanodeInfoWithStorage[127.0.0.1:33379,DS-85bd7c27-6423-4b66-904e-d40977896cd8,DISK]] 2023-02-13 20:03:39,958 DEBUG [Listener at localhost/35313] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 20:03:39,978 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53536, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 20:03:39,979 INFO [Listener at localhost/35313] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 20:03:39,979 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 20:03:39,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 20:03:39,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:53536 deadline: 1676318679979, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 20:03:39,981 INFO [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 20:03:39,984 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:39,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 20:03:39,989 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:03:39,989 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 20:03:39,990 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:03:39,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:40,000 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:40,000 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:40,000 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:40,000 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:40,000 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:40,000 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:40,000 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:40,001 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/218af36b91e3a190a3685972f43f3fb8 empty. 2023-02-13 20:03:40,000 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:40,001 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64 empty. 2023-02-13 20:03:40,001 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad empty. 2023-02-13 20:03:40,002 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1 empty. 2023-02-13 20:03:40,002 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f empty. 2023-02-13 20:03:40,002 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670 empty. 2023-02-13 20:03:40,002 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f empty. 2023-02-13 20:03:40,002 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12 empty. 2023-02-13 20:03:40,003 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:40,003 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:40,003 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:40,003 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:40,004 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:40,004 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:40,004 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:40,004 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:40,004 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/da50b6856686e7920b340ad5aae1ad70 empty. 2023-02-13 20:03:40,005 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:40,005 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:40,005 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99 empty. 2023-02-13 20:03:40,005 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:40,005 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:40,005 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 20:03:40,043 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:40,045 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 218af36b91e3a190a3685972f43f3fb8, NAME => 'testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp 2023-02-13 20:03:40,049 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 32a820bf08149a4bbdf760b6a28d8670, NAME => 'testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp 2023-02-13 20:03:40,049 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => f8e8200a41a8c68852aeae5c02624d12, NAME => 'testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp 2023-02-13 20:03:40,088 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,088 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 32a820bf08149a4bbdf760b6a28d8670, disabling compactions & flushes 2023-02-13 20:03:40,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 218af36b91e3a190a3685972f43f3fb8, disabling compactions & flushes 2023-02-13 20:03:40,089 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:40,089 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:40,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:40,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:40,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. after waiting 0 ms 2023-02-13 20:03:40,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. after waiting 0 ms 2023-02-13 20:03:40,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:40,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:40,089 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:40,089 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:40,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 218af36b91e3a190a3685972f43f3fb8: Waiting for close lock at 1676318620089Disabling compacts and flushes for region at 1676318620089Disabling writes for close at 1676318620089Writing region close event to WAL at 1676318620089Closed at 1676318620089 2023-02-13 20:03:40,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 32a820bf08149a4bbdf760b6a28d8670: Waiting for close lock at 1676318620088Disabling compacts and flushes for region at 1676318620088Disabling writes for close at 1676318620089 (+1 ms)Writing region close event to WAL at 1676318620089Closed at 1676318620089 2023-02-13 20:03:40,090 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 68ead255cc8f2f10aa4eb300d3a0a09f, NAME => 'testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp 2023-02-13 20:03:40,090 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => f8b5ff134a94a6f0cc543c9b3b8d77e1, NAME => 'testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp 2023-02-13 20:03:40,092 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,092 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing f8e8200a41a8c68852aeae5c02624d12, disabling compactions & flushes 2023-02-13 20:03:40,092 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:40,092 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:40,092 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. after waiting 0 ms 2023-02-13 20:03:40,092 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:40,092 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:40,092 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for f8e8200a41a8c68852aeae5c02624d12: Waiting for close lock at 1676318620092Disabling compacts and flushes for region at 1676318620092Disabling writes for close at 1676318620092Writing region close event to WAL at 1676318620092Closed at 1676318620092 2023-02-13 20:03:40,093 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => b12fe0deb333e53c3755e17b2405fb64, NAME => 'testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp 2023-02-13 20:03:40,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:40,116 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,116 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing b12fe0deb333e53c3755e17b2405fb64, disabling compactions & flushes 2023-02-13 20:03:40,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 68ead255cc8f2f10aa4eb300d3a0a09f, disabling compactions & flushes 2023-02-13 20:03:40,117 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:40,117 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:40,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:40,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:40,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. after waiting 0 ms 2023-02-13 20:03:40,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. after waiting 0 ms 2023-02-13 20:03:40,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:40,117 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:40,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:40,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for b12fe0deb333e53c3755e17b2405fb64: Waiting for close lock at 1676318620117Disabling compacts and flushes for region at 1676318620117Disabling writes for close at 1676318620117Writing region close event to WAL at 1676318620117Closed at 1676318620117 2023-02-13 20:03:40,117 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:40,117 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 68ead255cc8f2f10aa4eb300d3a0a09f: Waiting for close lock at 1676318620117Disabling compacts and flushes for region at 1676318620117Disabling writes for close at 1676318620117Writing region close event to WAL at 1676318620117Closed at 1676318620117 2023-02-13 20:03:40,118 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => c56a8077d900e7ab604cd2dd244d009f, NAME => 'testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp 2023-02-13 20:03:40,118 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2c7e5559b6db0de5a50c0da024f986ad, NAME => 'testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp 2023-02-13 20:03:40,119 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,119 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing f8b5ff134a94a6f0cc543c9b3b8d77e1, disabling compactions & flushes 2023-02-13 20:03:40,119 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:40,119 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:40,119 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. after waiting 0 ms 2023-02-13 20:03:40,119 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:40,119 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:40,119 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for f8b5ff134a94a6f0cc543c9b3b8d77e1: Waiting for close lock at 1676318620119Disabling compacts and flushes for region at 1676318620119Disabling writes for close at 1676318620119Writing region close event to WAL at 1676318620119Closed at 1676318620119 2023-02-13 20:03:40,120 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => e31a9c7a57e83fa2ddec4114989acd99, NAME => 'testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp 2023-02-13 20:03:40,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 2c7e5559b6db0de5a50c0da024f986ad, disabling compactions & flushes 2023-02-13 20:03:40,136 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:40,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:40,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. after waiting 0 ms 2023-02-13 20:03:40,136 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:40,137 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:40,137 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 2c7e5559b6db0de5a50c0da024f986ad: Waiting for close lock at 1676318620136Disabling compacts and flushes for region at 1676318620136Disabling writes for close at 1676318620136Writing region close event to WAL at 1676318620137 (+1 ms)Closed at 1676318620137 2023-02-13 20:03:40,137 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => da50b6856686e7920b340ad5aae1ad70, NAME => 'testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.tmp 2023-02-13 20:03:40,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing c56a8077d900e7ab604cd2dd244d009f, disabling compactions & flushes 2023-02-13 20:03:40,138 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:40,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:40,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. after waiting 0 ms 2023-02-13 20:03:40,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:40,138 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:40,138 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for c56a8077d900e7ab604cd2dd244d009f: Waiting for close lock at 1676318620138Disabling compacts and flushes for region at 1676318620138Disabling writes for close at 1676318620138Writing region close event to WAL at 1676318620138Closed at 1676318620138 2023-02-13 20:03:40,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing e31a9c7a57e83fa2ddec4114989acd99, disabling compactions & flushes 2023-02-13 20:03:40,140 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:40,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:40,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. after waiting 0 ms 2023-02-13 20:03:40,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:40,140 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:40,140 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for e31a9c7a57e83fa2ddec4114989acd99: Waiting for close lock at 1676318620140Disabling compacts and flushes for region at 1676318620140Disabling writes for close at 1676318620140Writing region close event to WAL at 1676318620140Closed at 1676318620140 2023-02-13 20:03:40,145 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,145 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing da50b6856686e7920b340ad5aae1ad70, disabling compactions & flushes 2023-02-13 20:03:40,146 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:40,146 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:40,146 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. after waiting 0 ms 2023-02-13 20:03:40,146 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:40,146 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:40,146 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for da50b6856686e7920b340ad5aae1ad70: Waiting for close lock at 1676318620145Disabling compacts and flushes for region at 1676318620145Disabling writes for close at 1676318620146 (+1 ms)Writing region close event to WAL at 1676318620146Closed at 1676318620146 2023-02-13 20:03:40,150 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:03:40,152 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318620151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318620151"}]},"ts":"1676318620151"} 2023-02-13 20:03:40,152 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318620151"}]},"ts":"1676318620151"} 2023-02-13 20:03:40,152 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318620151"}]},"ts":"1676318620151"} 2023-02-13 20:03:40,152 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318620151"}]},"ts":"1676318620151"} 2023-02-13 20:03:40,152 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318620151"}]},"ts":"1676318620151"} 2023-02-13 20:03:40,152 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318620151"}]},"ts":"1676318620151"} 2023-02-13 20:03:40,152 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318620151"}]},"ts":"1676318620151"} 2023-02-13 20:03:40,152 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318620151"}]},"ts":"1676318620151"} 2023-02-13 20:03:40,152 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318620151"}]},"ts":"1676318620151"} 2023-02-13 20:03:40,152 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318620151"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318620151"}]},"ts":"1676318620151"} 2023-02-13 20:03:40,160 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 20:03:40,161 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:03:40,161 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318620161"}]},"ts":"1676318620161"} 2023-02-13 20:03:40,164 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 20:03:40,167 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:03:40,177 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:03:40,178 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:03:40,178 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:03:40,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=218af36b91e3a190a3685972f43f3fb8, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=32a820bf08149a4bbdf760b6a28d8670, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f8e8200a41a8c68852aeae5c02624d12, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=68ead255cc8f2f10aa4eb300d3a0a09f, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f8b5ff134a94a6f0cc543c9b3b8d77e1, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b12fe0deb333e53c3755e17b2405fb64, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c56a8077d900e7ab604cd2dd244d009f, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2c7e5559b6db0de5a50c0da024f986ad, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e31a9c7a57e83fa2ddec4114989acd99, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=da50b6856686e7920b340ad5aae1ad70, ASSIGN}] 2023-02-13 20:03:40,181 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=68ead255cc8f2f10aa4eb300d3a0a09f, ASSIGN 2023-02-13 20:03:40,181 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=32a820bf08149a4bbdf760b6a28d8670, ASSIGN 2023-02-13 20:03:40,181 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=218af36b91e3a190a3685972f43f3fb8, ASSIGN 2023-02-13 20:03:40,181 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f8e8200a41a8c68852aeae5c02624d12, ASSIGN 2023-02-13 20:03:40,182 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f8e8200a41a8c68852aeae5c02624d12, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34825,1676318618565; forceNewPlan=false, retain=false 2023-02-13 20:03:40,182 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=32a820bf08149a4bbdf760b6a28d8670, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34961,1676318618521; forceNewPlan=false, retain=false 2023-02-13 20:03:40,182 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=da50b6856686e7920b340ad5aae1ad70, ASSIGN 2023-02-13 20:03:40,182 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=68ead255cc8f2f10aa4eb300d3a0a09f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34825,1676318618565; forceNewPlan=false, retain=false 2023-02-13 20:03:40,182 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=218af36b91e3a190a3685972f43f3fb8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34825,1676318618565; forceNewPlan=false, retain=false 2023-02-13 20:03:40,183 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=2c7e5559b6db0de5a50c0da024f986ad, ASSIGN 2023-02-13 20:03:40,183 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e31a9c7a57e83fa2ddec4114989acd99, ASSIGN 2023-02-13 20:03:40,184 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=da50b6856686e7920b340ad5aae1ad70, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34961,1676318618521; forceNewPlan=false, retain=false 2023-02-13 20:03:40,184 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c56a8077d900e7ab604cd2dd244d009f, ASSIGN 2023-02-13 20:03:40,184 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b12fe0deb333e53c3755e17b2405fb64, ASSIGN 2023-02-13 20:03:40,185 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e31a9c7a57e83fa2ddec4114989acd99, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34825,1676318618565; forceNewPlan=false, retain=false 2023-02-13 20:03:40,185 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c56a8077d900e7ab604cd2dd244d009f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34961,1676318618521; forceNewPlan=false, retain=false 2023-02-13 20:03:40,185 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f8b5ff134a94a6f0cc543c9b3b8d77e1, ASSIGN 2023-02-13 20:03:40,185 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=2c7e5559b6db0de5a50c0da024f986ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34825,1676318618565; forceNewPlan=false, retain=false 2023-02-13 20:03:40,185 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b12fe0deb333e53c3755e17b2405fb64, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34961,1676318618521; forceNewPlan=false, retain=false 2023-02-13 20:03:40,186 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f8b5ff134a94a6f0cc543c9b3b8d77e1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34961,1676318618521; forceNewPlan=false, retain=false 2023-02-13 20:03:40,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:40,332 INFO [jenkins-hbase4:39879] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 20:03:40,337 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c56a8077d900e7ab604cd2dd244d009f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:40,337 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=da50b6856686e7920b340ad5aae1ad70, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:40,337 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=32a820bf08149a4bbdf760b6a28d8670, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:40,338 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318620337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318620337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318620337"}]},"ts":"1676318620337"} 2023-02-13 20:03:40,337 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f8b5ff134a94a6f0cc543c9b3b8d77e1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:40,338 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318620337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318620337"}]},"ts":"1676318620337"} 2023-02-13 20:03:40,337 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b12fe0deb333e53c3755e17b2405fb64, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:40,338 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318620337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318620337"}]},"ts":"1676318620337"} 2023-02-13 20:03:40,338 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318620337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318620337"}]},"ts":"1676318620337"} 2023-02-13 20:03:40,337 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620337"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318620337"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318620337"}]},"ts":"1676318620337"} 2023-02-13 20:03:40,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure da50b6856686e7920b340ad5aae1ad70, server=jenkins-hbase4.apache.org,34961,1676318618521}] 2023-02-13 20:03:40,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=15, state=RUNNABLE; OpenRegionProcedure f8b5ff134a94a6f0cc543c9b3b8d77e1, server=jenkins-hbase4.apache.org,34961,1676318618521}] 2023-02-13 20:03:40,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=16, state=RUNNABLE; OpenRegionProcedure b12fe0deb333e53c3755e17b2405fb64, server=jenkins-hbase4.apache.org,34961,1676318618521}] 2023-02-13 20:03:40,345 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=68ead255cc8f2f10aa4eb300d3a0a09f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:40,345 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620345"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318620345"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318620345"}]},"ts":"1676318620345"} 2023-02-13 20:03:40,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=12, state=RUNNABLE; OpenRegionProcedure 32a820bf08149a4bbdf760b6a28d8670, server=jenkins-hbase4.apache.org,34961,1676318618521}] 2023-02-13 20:03:40,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=17, state=RUNNABLE; OpenRegionProcedure c56a8077d900e7ab604cd2dd244d009f, server=jenkins-hbase4.apache.org,34961,1676318618521}] 2023-02-13 20:03:40,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=14, state=RUNNABLE; OpenRegionProcedure 68ead255cc8f2f10aa4eb300d3a0a09f, server=jenkins-hbase4.apache.org,34825,1676318618565}] 2023-02-13 20:03:40,349 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=2c7e5559b6db0de5a50c0da024f986ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:40,350 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620349"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318620349"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318620349"}]},"ts":"1676318620349"} 2023-02-13 20:03:40,353 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=e31a9c7a57e83fa2ddec4114989acd99, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:40,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=18, state=RUNNABLE; OpenRegionProcedure 2c7e5559b6db0de5a50c0da024f986ad, server=jenkins-hbase4.apache.org,34825,1676318618565}] 2023-02-13 20:03:40,353 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620353"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318620353"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318620353"}]},"ts":"1676318620353"} 2023-02-13 20:03:40,354 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=218af36b91e3a190a3685972f43f3fb8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:40,354 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318620354"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318620354"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318620354"}]},"ts":"1676318620354"} 2023-02-13 20:03:40,355 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=19, state=RUNNABLE; OpenRegionProcedure e31a9c7a57e83fa2ddec4114989acd99, server=jenkins-hbase4.apache.org,34825,1676318618565}] 2023-02-13 20:03:40,355 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f8e8200a41a8c68852aeae5c02624d12, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:40,355 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318620355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318620355"}]},"ts":"1676318620355"} 2023-02-13 20:03:40,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=11, state=RUNNABLE; OpenRegionProcedure 218af36b91e3a190a3685972f43f3fb8, server=jenkins-hbase4.apache.org,34825,1676318618565}] 2023-02-13 20:03:40,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=13, state=RUNNABLE; OpenRegionProcedure f8e8200a41a8c68852aeae5c02624d12, server=jenkins-hbase4.apache.org,34825,1676318618565}] 2023-02-13 20:03:40,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:40,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f8b5ff134a94a6f0cc543c9b3b8d77e1, NAME => 'testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 20:03:40,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:40,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:40,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:40,500 INFO [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:40,501 DEBUG [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f1 2023-02-13 20:03:40,501 DEBUG [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f1 2023-02-13 20:03:40,502 INFO [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8b5ff134a94a6f0cc543c9b3b8d77e1 columnFamilyName f1 2023-02-13 20:03:40,502 INFO [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] regionserver.HStore(310): Store=f8b5ff134a94a6f0cc543c9b3b8d77e1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,503 INFO [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:40,504 DEBUG [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f2 2023-02-13 20:03:40,505 DEBUG [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f2 2023-02-13 20:03:40,505 INFO [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8b5ff134a94a6f0cc543c9b3b8d77e1 columnFamilyName f2 2023-02-13 20:03:40,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:40,506 INFO [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] regionserver.HStore(310): Store=f8b5ff134a94a6f0cc543c9b3b8d77e1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 218af36b91e3a190a3685972f43f3fb8, NAME => 'testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 20:03:40,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:40,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:40,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:40,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:40,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:40,507 INFO [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:40,512 DEBUG [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/218af36b91e3a190a3685972f43f3fb8/f1 2023-02-13 20:03:40,512 DEBUG [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/218af36b91e3a190a3685972f43f3fb8/f1 2023-02-13 20:03:40,513 INFO [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 218af36b91e3a190a3685972f43f3fb8 columnFamilyName f1 2023-02-13 20:03:40,513 INFO [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] regionserver.HStore(310): Store=218af36b91e3a190a3685972f43f3fb8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,513 INFO [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:40,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:40,515 DEBUG [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/218af36b91e3a190a3685972f43f3fb8/f2 2023-02-13 20:03:40,515 DEBUG [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/218af36b91e3a190a3685972f43f3fb8/f2 2023-02-13 20:03:40,515 INFO [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 218af36b91e3a190a3685972f43f3fb8 columnFamilyName f2 2023-02-13 20:03:40,516 INFO [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] regionserver.HStore(310): Store=218af36b91e3a190a3685972f43f3fb8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:40,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:40,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:40,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:40,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:40,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f8b5ff134a94a6f0cc543c9b3b8d77e1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63288759, jitterRate=-0.0569240003824234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:40,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f8b5ff134a94a6f0cc543c9b3b8d77e1: Running coprocessor pre-open hook at 1676318620499Writing region info on filesystem at 1676318620499Initializing all the Stores at 1676318620500 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620500Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620500Cleaning up temporary data from old regions at 1676318620512 (+12 ms)Cleaning up detritus from prior splits at 1676318620512Running coprocessor post-open hooks at 1676318620520 (+8 ms)Region opened successfully at 1676318620520 2023-02-13 20:03:40,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1., pid=22, masterSystemTime=1676318620493 2023-02-13 20:03:40,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:40,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:40,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:40,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:40,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b12fe0deb333e53c3755e17b2405fb64, NAME => 'testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 20:03:40,523 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=f8b5ff134a94a6f0cc543c9b3b8d77e1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:40,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:40,523 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620523"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318620523"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318620523"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318620523"}]},"ts":"1676318620523"} 2023-02-13 20:03:40,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:40,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:40,527 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=15 2023-02-13 20:03:40,527 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=15, state=SUCCESS; OpenRegionProcedure f8b5ff134a94a6f0cc543c9b3b8d77e1, server=jenkins-hbase4.apache.org,34961,1676318618521 in 184 msec 2023-02-13 20:03:40,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f8b5ff134a94a6f0cc543c9b3b8d77e1, ASSIGN in 349 msec 2023-02-13 20:03:40,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/218af36b91e3a190a3685972f43f3fb8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:40,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 218af36b91e3a190a3685972f43f3fb8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72117362, jitterRate=0.0746324360370636}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:40,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 218af36b91e3a190a3685972f43f3fb8: Running coprocessor pre-open hook at 1676318620506Writing region info on filesystem at 1676318620506Initializing all the Stores at 1676318620507 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620507Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620507Cleaning up temporary data from old regions at 1676318620517 (+10 ms)Cleaning up detritus from prior splits at 1676318620519 (+2 ms)Running coprocessor post-open hooks at 1676318620530 (+11 ms)Region opened successfully at 1676318620530 2023-02-13 20:03:40,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8., pid=29, masterSystemTime=1676318620502 2023-02-13 20:03:40,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:40,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:40,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:40,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f8e8200a41a8c68852aeae5c02624d12, NAME => 'testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 20:03:40,533 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=218af36b91e3a190a3685972f43f3fb8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:40,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:40,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,533 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318620533"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318620533"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318620533"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318620533"}]},"ts":"1676318620533"} 2023-02-13 20:03:40,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:40,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:40,534 INFO [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:40,535 INFO [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:40,535 DEBUG [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f1 2023-02-13 20:03:40,535 DEBUG [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f1 2023-02-13 20:03:40,536 INFO [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b12fe0deb333e53c3755e17b2405fb64 columnFamilyName f1 2023-02-13 20:03:40,537 INFO [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] regionserver.HStore(310): Store=b12fe0deb333e53c3755e17b2405fb64/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,537 INFO [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:40,537 DEBUG [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f1 2023-02-13 20:03:40,537 DEBUG [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f1 2023-02-13 20:03:40,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=11 2023-02-13 20:03:40,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=11, state=SUCCESS; OpenRegionProcedure 218af36b91e3a190a3685972f43f3fb8, server=jenkins-hbase4.apache.org,34825,1676318618565 in 179 msec 2023-02-13 20:03:40,537 INFO [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8e8200a41a8c68852aeae5c02624d12 columnFamilyName f1 2023-02-13 20:03:40,538 INFO [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] regionserver.HStore(310): Store=f8e8200a41a8c68852aeae5c02624d12/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,538 INFO [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:40,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=218af36b91e3a190a3685972f43f3fb8, ASSIGN in 359 msec 2023-02-13 20:03:40,538 DEBUG [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f2 2023-02-13 20:03:40,538 DEBUG [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f2 2023-02-13 20:03:40,539 INFO [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b12fe0deb333e53c3755e17b2405fb64 columnFamilyName f2 2023-02-13 20:03:40,539 INFO [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] regionserver.HStore(310): Store=b12fe0deb333e53c3755e17b2405fb64/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,540 DEBUG [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f2 2023-02-13 20:03:40,540 DEBUG [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f2 2023-02-13 20:03:40,540 INFO [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8e8200a41a8c68852aeae5c02624d12 columnFamilyName f2 2023-02-13 20:03:40,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:40,540 INFO [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] regionserver.HStore(310): Store=f8e8200a41a8c68852aeae5c02624d12/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:40,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:40,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:40,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:40,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:40,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:40,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:40,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:40,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b12fe0deb333e53c3755e17b2405fb64; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61276413, jitterRate=-0.08691029250621796}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:40,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b12fe0deb333e53c3755e17b2405fb64: Running coprocessor pre-open hook at 1676318620524Writing region info on filesystem at 1676318620524Initializing all the Stores at 1676318620524Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620524Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620529 (+5 ms)Cleaning up temporary data from old regions at 1676318620541 (+12 ms)Cleaning up detritus from prior splits at 1676318620542 (+1 ms)Running coprocessor post-open hooks at 1676318620547 (+5 ms)Region opened successfully at 1676318620547 2023-02-13 20:03:40,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:40,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64., pid=23, masterSystemTime=1676318620493 2023-02-13 20:03:40,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f8e8200a41a8c68852aeae5c02624d12; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62132845, jitterRate=-0.07414846122264862}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:40,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f8e8200a41a8c68852aeae5c02624d12: Running coprocessor pre-open hook at 1676318620534Writing region info on filesystem at 1676318620534Initializing all the Stores at 1676318620535 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620535Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620535Cleaning up temporary data from old regions at 1676318620542 (+7 ms)Cleaning up detritus from prior splits at 1676318620543 (+1 ms)Running coprocessor post-open hooks at 1676318620548 (+5 ms)Region opened successfully at 1676318620548 2023-02-13 20:03:40,548 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12., pid=30, masterSystemTime=1676318620502 2023-02-13 20:03:40,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:40,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:40,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:40,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 32a820bf08149a4bbdf760b6a28d8670, NAME => 'testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 20:03:40,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:40,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:40,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:40,550 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b12fe0deb333e53c3755e17b2405fb64, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:40,550 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620550"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318620550"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318620550"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318620550"}]},"ts":"1676318620550"} 2023-02-13 20:03:40,550 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f8e8200a41a8c68852aeae5c02624d12, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:40,551 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620550"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318620550"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318620550"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318620550"}]},"ts":"1676318620550"} 2023-02-13 20:03:40,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:40,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:40,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:40,552 INFO [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:40,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e31a9c7a57e83fa2ddec4114989acd99, NAME => 'testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 20:03:40,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:40,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:40,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:40,554 DEBUG [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f1 2023-02-13 20:03:40,554 DEBUG [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f1 2023-02-13 20:03:40,554 INFO [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32a820bf08149a4bbdf760b6a28d8670 columnFamilyName f1 2023-02-13 20:03:40,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=16 2023-02-13 20:03:40,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=16, state=SUCCESS; OpenRegionProcedure b12fe0deb333e53c3755e17b2405fb64, server=jenkins-hbase4.apache.org,34961,1676318618521 in 208 msec 2023-02-13 20:03:40,555 INFO [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] regionserver.HStore(310): Store=32a820bf08149a4bbdf760b6a28d8670/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=13 2023-02-13 20:03:40,555 INFO [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:40,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=13, state=SUCCESS; OpenRegionProcedure f8e8200a41a8c68852aeae5c02624d12, server=jenkins-hbase4.apache.org,34825,1676318618565 in 196 msec 2023-02-13 20:03:40,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b12fe0deb333e53c3755e17b2405fb64, ASSIGN in 377 msec 2023-02-13 20:03:40,557 DEBUG [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f2 2023-02-13 20:03:40,557 DEBUG [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f2 2023-02-13 20:03:40,557 INFO [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32a820bf08149a4bbdf760b6a28d8670 columnFamilyName f2 2023-02-13 20:03:40,558 INFO [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] regionserver.HStore(310): Store=32a820bf08149a4bbdf760b6a28d8670/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,558 INFO [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:40,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f8e8200a41a8c68852aeae5c02624d12, ASSIGN in 377 msec 2023-02-13 20:03:40,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:40,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:40,560 DEBUG [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f1 2023-02-13 20:03:40,560 DEBUG [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f1 2023-02-13 20:03:40,561 INFO [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e31a9c7a57e83fa2ddec4114989acd99 columnFamilyName f1 2023-02-13 20:03:40,562 INFO [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] regionserver.HStore(310): Store=e31a9c7a57e83fa2ddec4114989acd99/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,562 INFO [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:40,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:40,563 DEBUG [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f2 2023-02-13 20:03:40,563 DEBUG [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f2 2023-02-13 20:03:40,563 INFO [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e31a9c7a57e83fa2ddec4114989acd99 columnFamilyName f2 2023-02-13 20:03:40,564 INFO [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] regionserver.HStore(310): Store=e31a9c7a57e83fa2ddec4114989acd99/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:40,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:40,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:40,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:40,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 32a820bf08149a4bbdf760b6a28d8670; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67775749, jitterRate=0.009937360882759094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:40,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 32a820bf08149a4bbdf760b6a28d8670: Running coprocessor pre-open hook at 1676318620550Writing region info on filesystem at 1676318620550Initializing all the Stores at 1676318620551 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620551Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620551Cleaning up temporary data from old regions at 1676318620561 (+10 ms)Cleaning up detritus from prior splits at 1676318620561Running coprocessor post-open hooks at 1676318620568 (+7 ms)Region opened successfully at 1676318620568 2023-02-13 20:03:40,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:40,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670., pid=24, masterSystemTime=1676318620493 2023-02-13 20:03:40,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:40,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:40,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:40,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:40,571 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=32a820bf08149a4bbdf760b6a28d8670, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:40,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c56a8077d900e7ab604cd2dd244d009f, NAME => 'testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 20:03:40,572 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620571"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318620571"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318620571"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318620571"}]},"ts":"1676318620571"} 2023-02-13 20:03:40,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:40,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:40,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:40,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=12 2023-02-13 20:03:40,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=12, state=SUCCESS; OpenRegionProcedure 32a820bf08149a4bbdf760b6a28d8670, server=jenkins-hbase4.apache.org,34961,1676318618521 in 229 msec 2023-02-13 20:03:40,576 INFO [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:40,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=32a820bf08149a4bbdf760b6a28d8670, ASSIGN in 397 msec 2023-02-13 20:03:40,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:40,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e31a9c7a57e83fa2ddec4114989acd99; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69350735, jitterRate=0.03340648114681244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:40,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e31a9c7a57e83fa2ddec4114989acd99: Running coprocessor pre-open hook at 1676318620552Writing region info on filesystem at 1676318620552Initializing all the Stores at 1676318620553 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620553Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620558 (+5 ms)Cleaning up temporary data from old regions at 1676318620567 (+9 ms)Cleaning up detritus from prior splits at 1676318620567Running coprocessor post-open hooks at 1676318620577 (+10 ms)Region opened successfully at 1676318620577 2023-02-13 20:03:40,578 DEBUG [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f1 2023-02-13 20:03:40,578 DEBUG [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f1 2023-02-13 20:03:40,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99., pid=28, masterSystemTime=1676318620502 2023-02-13 20:03:40,579 INFO [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c56a8077d900e7ab604cd2dd244d009f columnFamilyName f1 2023-02-13 20:03:40,579 INFO [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] regionserver.HStore(310): Store=c56a8077d900e7ab604cd2dd244d009f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:40,580 INFO [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:40,580 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=e31a9c7a57e83fa2ddec4114989acd99, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:40,580 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620580"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318620580"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318620580"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318620580"}]},"ts":"1676318620580"} 2023-02-13 20:03:40,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:40,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:40,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2c7e5559b6db0de5a50c0da024f986ad, NAME => 'testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 20:03:40,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:40,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:40,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:40,582 DEBUG [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f2 2023-02-13 20:03:40,582 DEBUG [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f2 2023-02-13 20:03:40,583 INFO [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c56a8077d900e7ab604cd2dd244d009f columnFamilyName f2 2023-02-13 20:03:40,583 INFO [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:40,583 INFO [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] regionserver.HStore(310): Store=c56a8077d900e7ab604cd2dd244d009f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=19 2023-02-13 20:03:40,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=19, state=SUCCESS; OpenRegionProcedure e31a9c7a57e83fa2ddec4114989acd99, server=jenkins-hbase4.apache.org,34825,1676318618565 in 227 msec 2023-02-13 20:03:40,585 DEBUG [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f1 2023-02-13 20:03:40,585 DEBUG [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f1 2023-02-13 20:03:40,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:40,585 INFO [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c7e5559b6db0de5a50c0da024f986ad columnFamilyName f1 2023-02-13 20:03:40,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:40,586 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e31a9c7a57e83fa2ddec4114989acd99, ASSIGN in 406 msec 2023-02-13 20:03:40,586 INFO [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] regionserver.HStore(310): Store=2c7e5559b6db0de5a50c0da024f986ad/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,586 INFO [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:40,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:40,587 DEBUG [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f2 2023-02-13 20:03:40,587 DEBUG [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f2 2023-02-13 20:03:40,588 INFO [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c7e5559b6db0de5a50c0da024f986ad columnFamilyName f2 2023-02-13 20:03:40,588 INFO [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] regionserver.HStore(310): Store=2c7e5559b6db0de5a50c0da024f986ad/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:40,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:40,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:40,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:40,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c56a8077d900e7ab604cd2dd244d009f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63703334, jitterRate=-0.05074635148048401}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:40,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c56a8077d900e7ab604cd2dd244d009f: Running coprocessor pre-open hook at 1676318620572Writing region info on filesystem at 1676318620572Initializing all the Stores at 1676318620573 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620573Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620576 (+3 ms)Cleaning up temporary data from old regions at 1676318620586 (+10 ms)Cleaning up detritus from prior splits at 1676318620586Running coprocessor post-open hooks at 1676318620591 (+5 ms)Region opened successfully at 1676318620591 2023-02-13 20:03:40,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f., pid=25, masterSystemTime=1676318620493 2023-02-13 20:03:40,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:40,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:40,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:40,595 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=c56a8077d900e7ab604cd2dd244d009f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:40,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => da50b6856686e7920b340ad5aae1ad70, NAME => 'testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 20:03:40,595 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620595"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318620595"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318620595"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318620595"}]},"ts":"1676318620595"} 2023-02-13 20:03:40,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:40,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:40,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:40,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:40,597 INFO [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:40,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:40,599 DEBUG [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/da50b6856686e7920b340ad5aae1ad70/f1 2023-02-13 20:03:40,599 DEBUG [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/da50b6856686e7920b340ad5aae1ad70/f1 2023-02-13 20:03:40,599 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=17 2023-02-13 20:03:40,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=17, state=SUCCESS; OpenRegionProcedure c56a8077d900e7ab604cd2dd244d009f, server=jenkins-hbase4.apache.org,34961,1676318618521 in 251 msec 2023-02-13 20:03:40,600 INFO [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da50b6856686e7920b340ad5aae1ad70 columnFamilyName f1 2023-02-13 20:03:40,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:40,601 INFO [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] regionserver.HStore(310): Store=da50b6856686e7920b340ad5aae1ad70/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,601 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c56a8077d900e7ab604cd2dd244d009f, ASSIGN in 422 msec 2023-02-13 20:03:40,601 INFO [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:40,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:40,603 DEBUG [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/da50b6856686e7920b340ad5aae1ad70/f2 2023-02-13 20:03:40,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 2c7e5559b6db0de5a50c0da024f986ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65430019, jitterRate=-0.02501673996448517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:40,603 DEBUG [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/da50b6856686e7920b340ad5aae1ad70/f2 2023-02-13 20:03:40,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 2c7e5559b6db0de5a50c0da024f986ad: Running coprocessor pre-open hook at 1676318620581Writing region info on filesystem at 1676318620581Initializing all the Stores at 1676318620582 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620582Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620583 (+1 ms)Cleaning up temporary data from old regions at 1676318620591 (+8 ms)Cleaning up detritus from prior splits at 1676318620591Running coprocessor post-open hooks at 1676318620603 (+12 ms)Region opened successfully at 1676318620603 2023-02-13 20:03:40,603 INFO [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da50b6856686e7920b340ad5aae1ad70 columnFamilyName f2 2023-02-13 20:03:40,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad., pid=27, masterSystemTime=1676318620502 2023-02-13 20:03:40,604 INFO [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] regionserver.HStore(310): Store=da50b6856686e7920b340ad5aae1ad70/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:40,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:40,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:40,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:40,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:40,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 68ead255cc8f2f10aa4eb300d3a0a09f, NAME => 'testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 20:03:40,605 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=2c7e5559b6db0de5a50c0da024f986ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:40,606 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620605"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318620605"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318620605"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318620605"}]},"ts":"1676318620605"} 2023-02-13 20:03:40,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:40,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:40,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:40,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:40,607 INFO [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:40,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:40,609 DEBUG [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f1 2023-02-13 20:03:40,609 DEBUG [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f1 2023-02-13 20:03:40,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=18 2023-02-13 20:03:40,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=18, state=SUCCESS; OpenRegionProcedure 2c7e5559b6db0de5a50c0da024f986ad, server=jenkins-hbase4.apache.org,34825,1676318618565 in 254 msec 2023-02-13 20:03:40,610 INFO [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68ead255cc8f2f10aa4eb300d3a0a09f columnFamilyName f1 2023-02-13 20:03:40,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=2c7e5559b6db0de5a50c0da024f986ad, ASSIGN in 431 msec 2023-02-13 20:03:40,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:40,611 INFO [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] regionserver.HStore(310): Store=68ead255cc8f2f10aa4eb300d3a0a09f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,611 INFO [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:40,612 DEBUG [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f2 2023-02-13 20:03:40,612 DEBUG [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f2 2023-02-13 20:03:40,613 INFO [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68ead255cc8f2f10aa4eb300d3a0a09f columnFamilyName f2 2023-02-13 20:03:40,613 INFO [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] regionserver.HStore(310): Store=68ead255cc8f2f10aa4eb300d3a0a09f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:40,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/da50b6856686e7920b340ad5aae1ad70/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:40,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:40,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened da50b6856686e7920b340ad5aae1ad70; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62335188, jitterRate=-0.0711333155632019}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:40,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for da50b6856686e7920b340ad5aae1ad70: Running coprocessor pre-open hook at 1676318620596Writing region info on filesystem at 1676318620596Initializing all the Stores at 1676318620597 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620597Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620597Cleaning up temporary data from old regions at 1676318620606 (+9 ms)Cleaning up detritus from prior splits at 1676318620607 (+1 ms)Running coprocessor post-open hooks at 1676318620616 (+9 ms)Region opened successfully at 1676318620616 2023-02-13 20:03:40,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:40,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70., pid=21, masterSystemTime=1676318620493 2023-02-13 20:03:40,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:40,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:40,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:40,619 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=da50b6856686e7920b340ad5aae1ad70, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:40,619 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676318620619"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318620619"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318620619"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318620619"}]},"ts":"1676318620619"} 2023-02-13 20:03:40,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:40,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:40,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-13 20:03:40,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure da50b6856686e7920b340ad5aae1ad70, server=jenkins-hbase4.apache.org,34961,1676318618521 in 281 msec 2023-02-13 20:03:40,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 68ead255cc8f2f10aa4eb300d3a0a09f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66247262, jitterRate=-0.012838870286941528}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:40,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 68ead255cc8f2f10aa4eb300d3a0a09f: Running coprocessor pre-open hook at 1676318620606Writing region info on filesystem at 1676318620606Initializing all the Stores at 1676318620607 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620607Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318620607Cleaning up temporary data from old regions at 1676318620617 (+10 ms)Cleaning up detritus from prior splits at 1676318620618 (+1 ms)Running coprocessor post-open hooks at 1676318620623 (+5 ms)Region opened successfully at 1676318620623 2023-02-13 20:03:40,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f., pid=26, masterSystemTime=1676318620502 2023-02-13 20:03:40,624 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=da50b6856686e7920b340ad5aae1ad70, ASSIGN in 445 msec 2023-02-13 20:03:40,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:40,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:40,626 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=68ead255cc8f2f10aa4eb300d3a0a09f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:40,626 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676318620626"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318620626"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318620626"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318620626"}]},"ts":"1676318620626"} 2023-02-13 20:03:40,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=14 2023-02-13 20:03:40,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=14, state=SUCCESS; OpenRegionProcedure 68ead255cc8f2f10aa4eb300d3a0a09f, server=jenkins-hbase4.apache.org,34825,1676318618565 in 281 msec 2023-02-13 20:03:40,631 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=10 2023-02-13 20:03:40,631 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=68ead255cc8f2f10aa4eb300d3a0a09f, ASSIGN in 451 msec 2023-02-13 20:03:40,632 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:03:40,632 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318620632"}]},"ts":"1676318620632"} 2023-02-13 20:03:40,633 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 20:03:40,635 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:03:40,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 650 msec 2023-02-13 20:03:41,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:41,100 INFO [Listener at localhost/35313] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 20:03:41,100 DEBUG [Listener at localhost/35313] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 20:03:41,100 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:03:41,105 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 20:03:41,105 INFO [Listener at localhost/35313] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:03:41,105 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 20:03:41,105 INFO [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 20:03:41,161 DEBUG [hconnection-0x68572e05-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:41,185 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36278, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:41,202 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34961] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:41,204 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34825] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:41,282 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 20:03:41,324 INFO [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 20:03:41,324 INFO [Listener at localhost/35313] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 20:03:41,326 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 20:03:41,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676318621326 (current time:1676318621326). 2023-02-13 20:03:41,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 20:03:41,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] zookeeper.ReadOnlyZKClient(139): Connect 0x51336c90 to 127.0.0.1:53275 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:41,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b9c6b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:41,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:41,408 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49644, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:41,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51336c90 to 127.0.0.1:53275 2023-02-13 20:03:41,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:41,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 20:03:41,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 20:03:41,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 20:03:41,417 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 20:03:41,418 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676319221418 2023-02-13 20:03:41,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 20:03:41,419 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 20:03:41,419 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 20:03:41,419 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 20:03:41,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 20:03:41,422 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 20:03:41,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 7 msec 2023-02-13 20:03:41,424 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 20:03:41,424 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676319221424 2023-02-13 20:03:41,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,453 INFO [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-13 20:03:41,453 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:03:41,454 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-13 20:03:41,454 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-13 20:03:41,516 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,516 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,517 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:41,518 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:41,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:41,518 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:41,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:41,518 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:41,518 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,518 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:41,518 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:03:41,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-13 20:03:41,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-13 20:03:41,519 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:41,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 20:03:41,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,520 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 20:03:41,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,521 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-13 20:03:41,521 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:03:41,522 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-13 20:03:41,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 20:03:41,522 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-13 20:03:41,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:03:41,522 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-13 20:03:41,522 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34825,1676318618565' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-13 20:03:41,522 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:03:41,523 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 20:03:41,523 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-13 20:03:41,523 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-13 20:03:41,523 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34961,1676318618521' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-13 20:03:41,524 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,524 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:41,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:41,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:41,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:41,526 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:41,526 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:41,526 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,527 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:41,527 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,527 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:41,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:41,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34825,1676318618565' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-13 20:03:41,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a037696[Count = 1] remaining members to acquire global barrier 2023-02-13 20:03:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:41,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34961,1676318618521' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-13 20:03:41,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a037696[Count = 0] remaining members to acquire global barrier 2023-02-13 20:03:41,531 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-13 20:03:41,531 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,532 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,532 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,532 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-13 20:03:41,532 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:41,532 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-13 20:03:41,532 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:41,532 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. started... 2023-02-13 20:03:41,533 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:41,533 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:03:41,533 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:41,533 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:41,533 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. started... 2023-02-13 20:03:41,534 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 20:03:41,534 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 218af36b91e3a190a3685972f43f3fb8: 2023-02-13 20:03:41,534 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:41,534 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. started... 2023-02-13 20:03:41,534 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. started... 2023-02-13 20:03:41,534 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:41,534 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 20:03:41,534 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. started... 2023-02-13 20:03:41,534 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,534 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:41,534 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 20:03:41,534 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 20:03:41,535 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 20:03:41,536 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HRegion(2744): Flushing f8b5ff134a94a6f0cc543c9b3b8d77e1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:41,536 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] regionserver.HRegion(2744): Flushing c56a8077d900e7ab604cd2dd244d009f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:41,536 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 32a820bf08149a4bbdf760b6a28d8670 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 20:03:41,536 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] regionserver.HRegion(2744): Flushing f8e8200a41a8c68852aeae5c02624d12 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:41,536 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:41,536 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 20:03:41,537 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. started... 2023-02-13 20:03:41,540 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 2c7e5559b6db0de5a50c0da024f986ad 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:41,600 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. completed. 2023-02-13 20:03:41,600 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:41,600 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:41,600 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 20:03:41,600 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. started... 2023-02-13 20:03:41,613 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 68ead255cc8f2f10aa4eb300d3a0a09f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:41,624 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/.tmp/f1/2f3f5e3d30d24b68b4e003d8b2b4e430 2023-02-13 20:03:41,644 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/.tmp/f1/1a8be5bf5e1a4480acf9347c60535b25 2023-02-13 20:03:41,688 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/.tmp/f1/edf67476be18482ca310e8e5ccd97881 2023-02-13 20:03:41,690 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/.tmp/f1/78643beaf989446ea7111f7739dc86fa 2023-02-13 20:03:41,690 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/.tmp/f1/02aecb8d7b7e4f5b92c1578b60e02c9c 2023-02-13 20:03:41,724 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:41,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 20:03:41,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:03:41,726 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 20:03:41,756 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/.tmp/f1/f9e3c3208be64952bd9cc1c537774810 2023-02-13 20:03:41,824 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/.tmp/f2/916285bca7bf4075aaf9b7614d2fb81c 2023-02-13 20:03:41,829 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/.tmp/f2/480e74d7b53b4b4c9c0e0150b54d4d66 2023-02-13 20:03:41,832 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/.tmp/f1/78643beaf989446ea7111f7739dc86fa as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f1/78643beaf989446ea7111f7739dc86fa 2023-02-13 20:03:41,836 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/.tmp/f1/2f3f5e3d30d24b68b4e003d8b2b4e430 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f1/2f3f5e3d30d24b68b4e003d8b2b4e430 2023-02-13 20:03:41,840 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/.tmp/f2/5638c553eab94bf18315288ebb59dfee 2023-02-13 20:03:41,843 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f1/2f3f5e3d30d24b68b4e003d8b2b4e430, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:41,844 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/.tmp/f2/480e74d7b53b4b4c9c0e0150b54d4d66 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f2/480e74d7b53b4b4c9c0e0150b54d4d66 2023-02-13 20:03:41,846 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f1/78643beaf989446ea7111f7739dc86fa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:41,848 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/.tmp/f1/02aecb8d7b7e4f5b92c1578b60e02c9c as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f1/02aecb8d7b7e4f5b92c1578b60e02c9c 2023-02-13 20:03:41,849 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/.tmp/f2/916285bca7bf4075aaf9b7614d2fb81c as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f2/916285bca7bf4075aaf9b7614d2fb81c 2023-02-13 20:03:41,855 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/.tmp/f2/91470194051d42eebb6f3f37526efd4c 2023-02-13 20:03:41,857 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f1/02aecb8d7b7e4f5b92c1578b60e02c9c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 20:03:41,858 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/.tmp/f2/5638c553eab94bf18315288ebb59dfee as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f2/5638c553eab94bf18315288ebb59dfee 2023-02-13 20:03:41,859 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f2/916285bca7bf4075aaf9b7614d2fb81c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:41,860 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 2c7e5559b6db0de5a50c0da024f986ad in 320ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:41,860 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-13 20:03:41,860 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 2c7e5559b6db0de5a50c0da024f986ad: 2023-02-13 20:03:41,861 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,861 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:41,861 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f1/78643beaf989446ea7111f7739dc86fa] hfiles 2023-02-13 20:03:41,861 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f1/78643beaf989446ea7111f7739dc86fa for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,861 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f2/916285bca7bf4075aaf9b7614d2fb81c] hfiles 2023-02-13 20:03:41,861 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f2/916285bca7bf4075aaf9b7614d2fb81c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,862 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f2/480e74d7b53b4b4c9c0e0150b54d4d66, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:41,863 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f8b5ff134a94a6f0cc543c9b3b8d77e1 in 326ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:41,874 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for f8b5ff134a94a6f0cc543c9b3b8d77e1: 2023-02-13 20:03:41,874 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,875 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:41,875 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f1/2f3f5e3d30d24b68b4e003d8b2b4e430] hfiles 2023-02-13 20:03:41,875 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f1/2f3f5e3d30d24b68b4e003d8b2b4e430 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,875 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f2/480e74d7b53b4b4c9c0e0150b54d4d66] hfiles 2023-02-13 20:03:41,875 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f2/480e74d7b53b4b4c9c0e0150b54d4d66 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,904 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/.tmp/f2/46d317a13912476b875c54f410d169bf 2023-02-13 20:03:41,905 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f2/5638c553eab94bf18315288ebb59dfee, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 20:03:41,907 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 32a820bf08149a4bbdf760b6a28d8670 in 371ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:41,907 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 32a820bf08149a4bbdf760b6a28d8670: 2023-02-13 20:03:41,907 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,907 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:41,907 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f1/02aecb8d7b7e4f5b92c1578b60e02c9c] hfiles 2023-02-13 20:03:41,907 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f1/02aecb8d7b7e4f5b92c1578b60e02c9c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,907 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f2/5638c553eab94bf18315288ebb59dfee] hfiles 2023-02-13 20:03:41,907 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f2/5638c553eab94bf18315288ebb59dfee for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,912 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/.tmp/f2/8a9359e40628496b93cabf9becdaaa32 2023-02-13 20:03:41,915 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/.tmp/f1/edf67476be18482ca310e8e5ccd97881 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f1/edf67476be18482ca310e8e5ccd97881 2023-02-13 20:03:41,919 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/.tmp/f1/1a8be5bf5e1a4480acf9347c60535b25 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f1/1a8be5bf5e1a4480acf9347c60535b25 2023-02-13 20:03:41,923 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/.tmp/f1/f9e3c3208be64952bd9cc1c537774810 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f1/f9e3c3208be64952bd9cc1c537774810 2023-02-13 20:03:41,926 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f1/1a8be5bf5e1a4480acf9347c60535b25, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:41,928 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/.tmp/f2/91470194051d42eebb6f3f37526efd4c as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f2/91470194051d42eebb6f3f37526efd4c 2023-02-13 20:03:41,930 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f1/f9e3c3208be64952bd9cc1c537774810, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:41,932 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/.tmp/f2/8a9359e40628496b93cabf9becdaaa32 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f2/8a9359e40628496b93cabf9becdaaa32 2023-02-13 20:03:41,945 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. completed. 2023-02-13 20:03:41,945 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:41,945 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:41,945 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 20:03:41,945 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. started... 2023-02-13 20:03:41,945 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HRegion(2744): Flushing e31a9c7a57e83fa2ddec4114989acd99 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 20:03:41,951 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f1/edf67476be18482ca310e8e5ccd97881, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:41,952 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/.tmp/f2/46d317a13912476b875c54f410d169bf as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f2/46d317a13912476b875c54f410d169bf 2023-02-13 20:03:41,960 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. completed. 2023-02-13 20:03:41,961 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:41,960 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. completed. 2023-02-13 20:03:41,961 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:41,961 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 20:03:41,961 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 20:03:41,961 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:41,961 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:41,961 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. started... 2023-02-13 20:03:41,961 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. started... 2023-02-13 20:03:41,961 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for da50b6856686e7920b340ad5aae1ad70: 2023-02-13 20:03:41,961 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b12fe0deb333e53c3755e17b2405fb64 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:41,961 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,962 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:41,962 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 20:03:41,962 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 20:03:41,965 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f2/91470194051d42eebb6f3f37526efd4c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:41,966 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for f8e8200a41a8c68852aeae5c02624d12 in 430ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:41,966 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f8e8200a41a8c68852aeae5c02624d12: 2023-02-13 20:03:41,966 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,966 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:41,966 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f1/1a8be5bf5e1a4480acf9347c60535b25] hfiles 2023-02-13 20:03:41,966 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f1/1a8be5bf5e1a4480acf9347c60535b25 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,966 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f2/91470194051d42eebb6f3f37526efd4c] hfiles 2023-02-13 20:03:41,966 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f2/91470194051d42eebb6f3f37526efd4c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,981 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f2/8a9359e40628496b93cabf9becdaaa32, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:41,982 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 68ead255cc8f2f10aa4eb300d3a0a09f in 369ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:41,982 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 68ead255cc8f2f10aa4eb300d3a0a09f: 2023-02-13 20:03:41,982 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,982 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:41,982 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f1/f9e3c3208be64952bd9cc1c537774810] hfiles 2023-02-13 20:03:41,982 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f1/f9e3c3208be64952bd9cc1c537774810 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:41,982 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f2/8a9359e40628496b93cabf9becdaaa32] hfiles 2023-02-13 20:03:41,983 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f2/8a9359e40628496b93cabf9becdaaa32 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,005 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f2/46d317a13912476b875c54f410d169bf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:42,006 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for c56a8077d900e7ab604cd2dd244d009f in 470ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:42,006 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c56a8077d900e7ab604cd2dd244d009f: 2023-02-13 20:03:42,006 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,006 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:42,006 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f1/edf67476be18482ca310e8e5ccd97881] hfiles 2023-02-13 20:03:42,006 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f1/edf67476be18482ca310e8e5ccd97881 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,006 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f2/46d317a13912476b875c54f410d169bf] hfiles 2023-02-13 20:03:42,006 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f2/46d317a13912476b875c54f410d169bf for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,024 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/.tmp/f1/ddf14f2900ea424aab251dd2499cf0ec 2023-02-13 20:03:42,026 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:42,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 20:03:42,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:03:42,029 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 20:03:42,032 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. completed. 2023-02-13 20:03:42,032 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:42,032 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 20:03:42,040 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/.tmp/f1/2bb05189657641799ca968dddcf52a80 2023-02-13 20:03:42,080 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. completed. 2023-02-13 20:03:42,080 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:42,080 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 20:03:42,083 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. completed. 2023-02-13 20:03:42,083 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:42,083 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 20:03:42,092 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/.tmp/f2/fdcc85131faf4b06af677660dbfd64db 2023-02-13 20:03:42,096 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/.tmp/f2/fdd0e46abfaf42968fad18fd8efde5a7 2023-02-13 20:03:42,099 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/.tmp/f1/ddf14f2900ea424aab251dd2499cf0ec as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f1/ddf14f2900ea424aab251dd2499cf0ec 2023-02-13 20:03:42,102 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/.tmp/f1/2bb05189657641799ca968dddcf52a80 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f1/2bb05189657641799ca968dddcf52a80 2023-02-13 20:03:42,104 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f1/ddf14f2900ea424aab251dd2499cf0ec, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 20:03:42,105 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/.tmp/f2/fdcc85131faf4b06af677660dbfd64db as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f2/fdcc85131faf4b06af677660dbfd64db 2023-02-13 20:03:42,109 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f1/2bb05189657641799ca968dddcf52a80, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:42,111 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/.tmp/f2/fdd0e46abfaf42968fad18fd8efde5a7 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f2/fdd0e46abfaf42968fad18fd8efde5a7 2023-02-13 20:03:42,112 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f2/fdcc85131faf4b06af677660dbfd64db, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 20:03:42,113 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e31a9c7a57e83fa2ddec4114989acd99 in 168ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:42,113 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e31a9c7a57e83fa2ddec4114989acd99: 2023-02-13 20:03:42,113 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,113 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:42,113 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f1/ddf14f2900ea424aab251dd2499cf0ec] hfiles 2023-02-13 20:03:42,113 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f1/ddf14f2900ea424aab251dd2499cf0ec for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,113 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f2/fdcc85131faf4b06af677660dbfd64db] hfiles 2023-02-13 20:03:42,113 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f2/fdcc85131faf4b06af677660dbfd64db for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,117 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f2/fdd0e46abfaf42968fad18fd8efde5a7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:42,119 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b12fe0deb333e53c3755e17b2405fb64 in 158ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:42,119 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b12fe0deb333e53c3755e17b2405fb64: 2023-02-13 20:03:42,119 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,119 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:42,119 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f1/2bb05189657641799ca968dddcf52a80] hfiles 2023-02-13 20:03:42,119 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f1/2bb05189657641799ca968dddcf52a80 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,119 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f2/fdd0e46abfaf42968fad18fd8efde5a7] hfiles 2023-02-13 20:03:42,119 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f2/fdd0e46abfaf42968fad18fd8efde5a7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,127 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. completed. 2023-02-13 20:03:42,127 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:42,127 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 20:03:42,138 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. completed. 2023-02-13 20:03:42,138 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:42,138 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 20:03:42,138 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 20:03:42,138 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:42,138 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-13 20:03:42,139 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,34961,1676318618521' in zk 2023-02-13 20:03:42,140 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:42,140 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-13 20:03:42,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:42,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:42,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:42,141 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:42,141 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-13 20:03:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,34961,1676318618521': 2023-02-13 20:03:42,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34961,1676318618521' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 20:03:42,443 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. completed. 2023-02-13 20:03:42,443 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:42,443 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 20:03:42,443 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 20:03:42,443 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:42,443 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-13 20:03:42,443 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,34825,1676318618565' in zk 2023-02-13 20:03:42,445 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-13 20:03:42,445 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:42,445 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:42,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:42,445 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-13 20:03:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:42,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:42,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:42,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:42,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:42,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:42,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:42,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:42,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,34825,1676318618565': 2023-02-13 20:03:42,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34825,1676318618565' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 20:03:42,450 INFO [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-13 20:03:42,450 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:03:42,450 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:03:42,450 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,450 INFO [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 20:03:42,453 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,453 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:42,453 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,453 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:42,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,453 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:42,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:42,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:42,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:42,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:42,454 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:42,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,455 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:42,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:42,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:42,457 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:42,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:42,457 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:42,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:42,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:42,464 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:42,464 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,464 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:42,464 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:42,464 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:42,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:42,464 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:42,464 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,464 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:42,464 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:42,464 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:42,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:42,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:42,464 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:42,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,465 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,466 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:42,466 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,466 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:42,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:42,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,529 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:42,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 20:03:42,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:03:42,531 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 20:03:42,572 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-13 20:03:42,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,572 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:42,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676318621419Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676318622464 (+1045 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676318622466 (+2 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676318622489 (+23 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676318622502 (+13 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676318622572 (+70 ms) 2023-02-13 20:03:42,574 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 20:03:42,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.1540 sec 2023-02-13 20:03:43,531 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:43,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 20:03:43,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 20:03:43,533 INFO [Listener at localhost/35313] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 20:03:43,538 INFO [Listener at localhost/35313] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 20:03:43,546 INFO [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 20:03:43,803 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34961] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:43,803 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34825] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:43,893 INFO [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 20:03:43,900 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 20:03:43,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 20:03:43,903 INFO [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 20:03:43,903 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:03:43,904 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 20:03:43,904 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 20:03:43,904 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:43,904 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:43,906 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:43,906 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:43,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:43,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:43,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:43,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:43,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:43,907 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:43,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:43,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:43,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:43,908 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:43,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:03:43,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:43,908 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:43,908 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 20:03:43,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:03:43,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:43,909 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 20:03:43,909 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:43,909 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:03:43,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 20:03:43,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 20:03:43,912 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 20:03:43,912 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:03:43,916 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 20:03:43,917 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 20:03:43,917 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:03:43,917 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 20:03:43,917 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:43,917 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. started... 2023-02-13 20:03:43,917 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:43,918 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. started... 2023-02-13 20:03:43,918 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:43,918 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. started... 2023-02-13 20:03:43,918 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing f8b5ff134a94a6f0cc543c9b3b8d77e1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:43,918 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 218af36b91e3a190a3685972f43f3fb8: 2023-02-13 20:03:43,918 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:43,918 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 32a820bf08149a4bbdf760b6a28d8670 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 20:03:43,918 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 20:03:43,918 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 20:03:43,918 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:43,918 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. started... 2023-02-13 20:03:43,919 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing c56a8077d900e7ab604cd2dd244d009f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:43,919 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:43,919 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. started... 2023-02-13 20:03:43,919 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing f8e8200a41a8c68852aeae5c02624d12 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:43,919 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 20:03:43,920 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 20:03:43,924 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:43,924 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 20:03:43,924 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. started... 2023-02-13 20:03:43,925 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 68ead255cc8f2f10aa4eb300d3a0a09f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:43,925 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:43,925 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. started... 2023-02-13 20:03:43,925 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 2c7e5559b6db0de5a50c0da024f986ad 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:43,972 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/.tmp/f1/1947c8b03ba1441f99c4bedc4c958e82 2023-02-13 20:03:43,980 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/.tmp/f1/1aea3217a1fd497e9824091d426fa1b4 2023-02-13 20:03:43,981 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/.tmp/f1/ffafc2b6cf8c4f37a75faf222bcdbfcb 2023-02-13 20:03:43,992 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/.tmp/f1/45bb616e6ab247e38a2dfdb1da53597f 2023-02-13 20:03:44,012 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/.tmp/f1/5326a842561f4465bc2cf3b31b20b5e6 2023-02-13 20:03:44,012 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/.tmp/f1/d2814d320da04aaba9d451d1c7daf376 2023-02-13 20:03:44,027 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/.tmp/f2/e3a0e7d88c194ff0ac45dee151022558 2023-02-13 20:03:44,032 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/.tmp/f2/56a0c792ceb24eda9b441137d722d057 2023-02-13 20:03:44,033 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/.tmp/f2/7ffc15926f7440d28992284baeb17f9d 2023-02-13 20:03:44,036 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/.tmp/f1/1aea3217a1fd497e9824091d426fa1b4 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f1/1aea3217a1fd497e9824091d426fa1b4 2023-02-13 20:03:44,042 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/.tmp/f1/ffafc2b6cf8c4f37a75faf222bcdbfcb as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f1/ffafc2b6cf8c4f37a75faf222bcdbfcb 2023-02-13 20:03:44,044 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/.tmp/f2/4c142ec242ca400d9f1f853e5edcb46c 2023-02-13 20:03:44,045 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f1/1aea3217a1fd497e9824091d426fa1b4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:44,046 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/.tmp/f1/1947c8b03ba1441f99c4bedc4c958e82 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f1/1947c8b03ba1441f99c4bedc4c958e82 2023-02-13 20:03:44,047 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/.tmp/f2/e3a0e7d88c194ff0ac45dee151022558 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f2/e3a0e7d88c194ff0ac45dee151022558 2023-02-13 20:03:44,054 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f1/ffafc2b6cf8c4f37a75faf222bcdbfcb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:44,055 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/.tmp/f2/56a0c792ceb24eda9b441137d722d057 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f2/56a0c792ceb24eda9b441137d722d057 2023-02-13 20:03:44,058 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f1/1947c8b03ba1441f99c4bedc4c958e82, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:44,058 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f2/e3a0e7d88c194ff0ac45dee151022558, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:44,059 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/.tmp/f1/45bb616e6ab247e38a2dfdb1da53597f as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f1/45bb616e6ab247e38a2dfdb1da53597f 2023-02-13 20:03:44,060 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/.tmp/f2/7ffc15926f7440d28992284baeb17f9d as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f2/7ffc15926f7440d28992284baeb17f9d 2023-02-13 20:03:44,060 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 2c7e5559b6db0de5a50c0da024f986ad in 135ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:44,060 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 2c7e5559b6db0de5a50c0da024f986ad: 2023-02-13 20:03:44,060 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:44,067 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f1/45bb616e6ab247e38a2dfdb1da53597f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:44,068 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f2/7ffc15926f7440d28992284baeb17f9d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:44,068 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/.tmp/f2/48e1cfa47a2e4c109446fc2f9a7eb6f9 2023-02-13 20:03:44,068 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f2/56a0c792ceb24eda9b441137d722d057, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:44,069 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f8b5ff134a94a6f0cc543c9b3b8d77e1 in 151ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:44,069 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for f8b5ff134a94a6f0cc543c9b3b8d77e1: 2023-02-13 20:03:44,069 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:44,069 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:44,069 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. started... 2023-02-13 20:03:44,069 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 20:03:44,070 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for da50b6856686e7920b340ad5aae1ad70: 2023-02-13 20:03:44,070 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:44,070 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:44,070 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. started... 2023-02-13 20:03:44,070 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 20:03:44,070 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:44,070 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. started... 2023-02-13 20:03:44,070 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 68ead255cc8f2f10aa4eb300d3a0a09f in 145ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:44,070 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b12fe0deb333e53c3755e17b2405fb64 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:44,070 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/.tmp/f2/4c142ec242ca400d9f1f853e5edcb46c as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f2/4c142ec242ca400d9f1f853e5edcb46c 2023-02-13 20:03:44,070 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing e31a9c7a57e83fa2ddec4114989acd99 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 20:03:44,070 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 20:03:44,070 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 68ead255cc8f2f10aa4eb300d3a0a09f: 2023-02-13 20:03:44,071 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:44,071 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 20:03:44,078 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/.tmp/f1/d2814d320da04aaba9d451d1c7daf376 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f1/d2814d320da04aaba9d451d1c7daf376 2023-02-13 20:03:44,080 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f2/4c142ec242ca400d9f1f853e5edcb46c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:44,081 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for f8e8200a41a8c68852aeae5c02624d12 in 162ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:44,081 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f8e8200a41a8c68852aeae5c02624d12: 2023-02-13 20:03:44,081 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:44,081 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 20:03:44,084 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/.tmp/f2/e3268b9c8a96489980107c4e59b4fe3a 2023-02-13 20:03:44,085 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f1/d2814d320da04aaba9d451d1c7daf376, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 20:03:44,086 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/.tmp/f2/48e1cfa47a2e4c109446fc2f9a7eb6f9 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f2/48e1cfa47a2e4c109446fc2f9a7eb6f9 2023-02-13 20:03:44,092 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/.tmp/f1/5326a842561f4465bc2cf3b31b20b5e6 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f1/5326a842561f4465bc2cf3b31b20b5e6 2023-02-13 20:03:44,096 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f2/48e1cfa47a2e4c109446fc2f9a7eb6f9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 20:03:44,097 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f1/5326a842561f4465bc2cf3b31b20b5e6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:44,097 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 32a820bf08149a4bbdf760b6a28d8670 in 179ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:44,097 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 32a820bf08149a4bbdf760b6a28d8670: 2023-02-13 20:03:44,098 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:44,098 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 20:03:44,098 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/.tmp/f2/e3268b9c8a96489980107c4e59b4fe3a as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f2/e3268b9c8a96489980107c4e59b4fe3a 2023-02-13 20:03:44,110 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/.tmp/f1/667436508a8c48a3a77f72e494a74f6c 2023-02-13 20:03:44,111 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f2/e3268b9c8a96489980107c4e59b4fe3a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:44,112 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for c56a8077d900e7ab604cd2dd244d009f in 193ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:44,112 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c56a8077d900e7ab604cd2dd244d009f: 2023-02-13 20:03:44,112 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:44,112 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 20:03:44,113 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/.tmp/f1/8cfd04d113264fafbe06d13c23f03d8a 2023-02-13 20:03:44,144 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/.tmp/f2/e57d39f4fa5f4239a2b498735a76ebd9 2023-02-13 20:03:44,148 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/.tmp/f2/1787d885746f48ebb0bbdb1acaa60187 2023-02-13 20:03:44,150 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/.tmp/f1/8cfd04d113264fafbe06d13c23f03d8a as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f1/8cfd04d113264fafbe06d13c23f03d8a 2023-02-13 20:03:44,153 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/.tmp/f1/667436508a8c48a3a77f72e494a74f6c as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f1/667436508a8c48a3a77f72e494a74f6c 2023-02-13 20:03:44,155 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f1/8cfd04d113264fafbe06d13c23f03d8a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 20:03:44,156 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/.tmp/f2/e57d39f4fa5f4239a2b498735a76ebd9 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f2/e57d39f4fa5f4239a2b498735a76ebd9 2023-02-13 20:03:44,159 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f1/667436508a8c48a3a77f72e494a74f6c, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:44,160 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/.tmp/f2/1787d885746f48ebb0bbdb1acaa60187 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f2/1787d885746f48ebb0bbdb1acaa60187 2023-02-13 20:03:44,161 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f2/e57d39f4fa5f4239a2b498735a76ebd9, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 20:03:44,162 INFO [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e31a9c7a57e83fa2ddec4114989acd99 in 92ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:44,162 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e31a9c7a57e83fa2ddec4114989acd99: 2023-02-13 20:03:44,162 DEBUG [rs(jenkins-hbase4.apache.org,34825,1676318618565)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:44,162 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 20:03:44,162 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 20:03:44,163 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,163 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 20:03:44,163 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34825,1676318618565' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 20:03:44,164 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:44,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:44,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:44,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:44,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:44,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:44,166 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f2/1787d885746f48ebb0bbdb1acaa60187, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:44,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:44,167 INFO [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b12fe0deb333e53c3755e17b2405fb64 in 97ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:44,167 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b12fe0deb333e53c3755e17b2405fb64: 2023-02-13 20:03:44,167 DEBUG [rs(jenkins-hbase4.apache.org,34961,1676318618521)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:44,167 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 20:03:44,167 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 20:03:44,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34825,1676318618565' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 20:03:44,167 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e3cfd0e[Count = 1] remaining members to acquire global barrier 2023-02-13 20:03:44,168 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 20:03:44,168 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34961,1676318618521' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 20:03:44,170 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:44,170 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:44,170 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:44,170 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:44,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:44,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:44,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:44,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34961,1676318618521' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 20:03:44,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e3cfd0e[Count = 0] remaining members to acquire global barrier 2023-02-13 20:03:44,173 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 20:03:44,173 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:44,174 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:44,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:44,174 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:44,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:44,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:44,175 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 20:03:44,175 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 20:03:44,175 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,175 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 20:03:44,175 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,34825,1676318618565' in zk 2023-02-13 20:03:44,175 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 20:03:44,175 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,34961,1676318618521' in zk 2023-02-13 20:03:44,175 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,175 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:03:44,176 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 20:03:44,176 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:44,176 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,177 DEBUG [member: 'jenkins-hbase4.apache.org,34825,1676318618565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 20:03:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:44,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:44,178 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,178 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 20:03:44,178 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:44,178 DEBUG [member: 'jenkins-hbase4.apache.org,34961,1676318618521' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 20:03:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:44,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:44,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:44,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,34825,1676318618565': 2023-02-13 20:03:44,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34825,1676318618565' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-13 20:03:44,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:44,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:44,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:44,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:44,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:44,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:44,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:44,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,34961,1676318618521': 2023-02-13 20:03:44,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34961,1676318618521' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 20:03:44,185 INFO [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 20:03:44,185 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:03:44,185 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:03:44,185 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 20:03:44,185 INFO [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 20:03:44,188 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:44,188 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:44,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:44,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:44,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:44,188 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:44,188 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:44,188 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:44,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:44,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:44,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:44,189 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:44,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:44,190 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:44,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:44,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:44,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,192 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,192 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:03:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,195 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,195 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:44,195 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,195 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:03:44,195 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:44,196 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 20:03:44,196 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:44,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:44,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:44,196 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:44,196 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:44,196 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,196 DEBUG [(jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:44,196 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:44,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:44,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:44,196 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 20:03:44,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:44,196 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:44,197 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:03:44,197 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:03:44,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:44,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:44,198 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 20:03:44,198 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 20:03:44,298 DEBUG [Listener at localhost/35313] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 20:03:44,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39879] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 20:03:44,300 INFO [Listener at localhost/35313] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 20:03:44,300 DEBUG [Listener at localhost/35313] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15b90c3a to 127.0.0.1:53275 2023-02-13 20:03:44,300 DEBUG [Listener at localhost/35313] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:44,300 DEBUG [Listener at localhost/35313] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 20:03:44,300 DEBUG [Listener at localhost/35313] util.JVMClusterUtil(257): Found active master hash=1326876600, stopped=false 2023-02-13 20:03:44,300 INFO [Listener at localhost/35313] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39879,1676318618460 2023-02-13 20:03:44,302 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:44,302 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:44,302 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:44,302 INFO [Listener at localhost/35313] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 20:03:44,302 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:44,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:44,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:44,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:44,304 DEBUG [Listener at localhost/35313] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53b70a7d to 127.0.0.1:53275 2023-02-13 20:03:44,304 DEBUG [Listener at localhost/35313] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:44,304 INFO [Listener at localhost/35313] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34961,1676318618521' ***** 2023-02-13 20:03:44,304 INFO [Listener at localhost/35313] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:03:44,304 INFO [Listener at localhost/35313] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34825,1676318618565' ***** 2023-02-13 20:03:44,304 INFO [RS:0;jenkins-hbase4:34961] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:03:44,305 INFO [Listener at localhost/35313] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:03:44,305 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:03:44,305 INFO [RS:0;jenkins-hbase4:34961] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:03:44,306 INFO [RS:1;jenkins-hbase4:34825] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:03:44,306 INFO [RS:0;jenkins-hbase4:34961] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:03:44,306 INFO [RS:1;jenkins-hbase4:34825] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:03:44,306 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(3304): Received CLOSE for f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:44,306 INFO [RS:1;jenkins-hbase4:34825] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:03:44,306 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:03:44,307 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(3304): Received CLOSE for 218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:44,307 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(3304): Received CLOSE for 32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:44,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f8b5ff134a94a6f0cc543c9b3b8d77e1, disabling compactions & flushes 2023-02-13 20:03:44,307 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(3304): Received CLOSE for c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:44,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:44,307 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(3304): Received CLOSE for da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:44,307 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(3304): Received CLOSE for f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:44,307 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(3304): Received CLOSE for b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:44,307 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(3304): Received CLOSE for 4fe124c6119a7f92bad9e653b24cb046 2023-02-13 20:03:44,307 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,307 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(3304): Received CLOSE for 2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:44,307 DEBUG [RS:0;jenkins-hbase4:34961] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x791198c9 to 127.0.0.1:53275 2023-02-13 20:03:44,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 218af36b91e3a190a3685972f43f3fb8, disabling compactions & flushes 2023-02-13 20:03:44,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:44,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:44,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. after waiting 0 ms 2023-02-13 20:03:44,307 DEBUG [RS:0;jenkins-hbase4:34961] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:44,307 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(3304): Received CLOSE for 68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:44,308 INFO [RS:0;jenkins-hbase4:34961] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:03:44,308 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(3304): Received CLOSE for e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:44,308 INFO [RS:0;jenkins-hbase4:34961] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:03:44,308 INFO [RS:0;jenkins-hbase4:34961] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:03:44,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:44,308 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 20:03:44,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:44,308 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. after waiting 0 ms 2023-02-13 20:03:44,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:44,308 DEBUG [RS:1;jenkins-hbase4:34825] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cc80f0d to 127.0.0.1:53275 2023-02-13 20:03:44,308 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:03:44,308 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-13 20:03:44,308 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:03:44,308 DEBUG [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(1479): Online Regions={f8b5ff134a94a6f0cc543c9b3b8d77e1=testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1., 32a820bf08149a4bbdf760b6a28d8670=testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670., c56a8077d900e7ab604cd2dd244d009f=testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f., da50b6856686e7920b340ad5aae1ad70=testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70., 1588230740=hbase:meta,,1.1588230740, b12fe0deb333e53c3755e17b2405fb64=testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64.} 2023-02-13 20:03:44,308 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:03:44,308 DEBUG [RS:1;jenkins-hbase4:34825] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:44,310 DEBUG [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(1505): Waiting on 1588230740, 32a820bf08149a4bbdf760b6a28d8670, b12fe0deb333e53c3755e17b2405fb64, c56a8077d900e7ab604cd2dd244d009f, da50b6856686e7920b340ad5aae1ad70, f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:44,310 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:03:44,311 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-13 20:03:44,312 DEBUG [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(1479): Online Regions={218af36b91e3a190a3685972f43f3fb8=testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8., f8e8200a41a8c68852aeae5c02624d12=testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12., 4fe124c6119a7f92bad9e653b24cb046=hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046., 2c7e5559b6db0de5a50c0da024f986ad=testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad., 68ead255cc8f2f10aa4eb300d3a0a09f=testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f., e31a9c7a57e83fa2ddec4114989acd99=testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99.} 2023-02-13 20:03:44,312 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:03:44,312 DEBUG [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(1505): Waiting on 218af36b91e3a190a3685972f43f3fb8, 2c7e5559b6db0de5a50c0da024f986ad, 4fe124c6119a7f92bad9e653b24cb046, 68ead255cc8f2f10aa4eb300d3a0a09f, e31a9c7a57e83fa2ddec4114989acd99, f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:44,313 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-13 20:03:44,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/218af36b91e3a190a3685972f43f3fb8/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 20:03:44,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:44,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:44,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 218af36b91e3a190a3685972f43f3fb8: Waiting for close lock at 1676318624307Running coprocessor pre-close hooks at 1676318624307Disabling compacts and flushes for region at 1676318624307Disabling writes for close at 1676318624308 (+1 ms)Writing region close event to WAL at 1676318624310 (+2 ms)Running coprocessor post-close hooks at 1676318624318 (+8 ms)Closed at 1676318624318 2023-02-13 20:03:44,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:44,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f8e8200a41a8c68852aeae5c02624d12, disabling compactions & flushes 2023-02-13 20:03:44,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:44,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:44,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. after waiting 0 ms 2023-02-13 20:03:44,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:44,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:44,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f8b5ff134a94a6f0cc543c9b3b8d77e1: Waiting for close lock at 1676318624307Running coprocessor pre-close hooks at 1676318624307Disabling compacts and flushes for region at 1676318624307Disabling writes for close at 1676318624308 (+1 ms)Writing region close event to WAL at 1676318624314 (+6 ms)Running coprocessor post-close hooks at 1676318624320 (+6 ms)Closed at 1676318624320 2023-02-13 20:03:44,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:44,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 32a820bf08149a4bbdf760b6a28d8670, disabling compactions & flushes 2023-02-13 20:03:44,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:44,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:44,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. after waiting 1 ms 2023-02-13 20:03:44,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:44,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:44,335 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/.tmp/info/be64a95ad34546ed8544d280121f8eb6 2023-02-13 20:03:44,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:44,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f8e8200a41a8c68852aeae5c02624d12: Waiting for close lock at 1676318624319Running coprocessor pre-close hooks at 1676318624319Disabling compacts and flushes for region at 1676318624319Disabling writes for close at 1676318624319Writing region close event to WAL at 1676318624326 (+7 ms)Running coprocessor post-close hooks at 1676318624335 (+9 ms)Closed at 1676318624336 (+1 ms) 2023-02-13 20:03:44,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:44,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4fe124c6119a7f92bad9e653b24cb046, disabling compactions & flushes 2023-02-13 20:03:44,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. 2023-02-13 20:03:44,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. 2023-02-13 20:03:44,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. after waiting 0 ms 2023-02-13 20:03:44,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. 2023-02-13 20:03:44,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 4fe124c6119a7f92bad9e653b24cb046 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 20:03:44,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:44,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:44,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 32a820bf08149a4bbdf760b6a28d8670: Waiting for close lock at 1676318624323Running coprocessor pre-close hooks at 1676318624323Disabling compacts and flushes for region at 1676318624323Disabling writes for close at 1676318624326 (+3 ms)Writing region close event to WAL at 1676318624332 (+6 ms)Running coprocessor post-close hooks at 1676318624337 (+5 ms)Closed at 1676318624337 2023-02-13 20:03:44,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:44,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c56a8077d900e7ab604cd2dd244d009f, disabling compactions & flushes 2023-02-13 20:03:44,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:44,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:44,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. after waiting 0 ms 2023-02-13 20:03:44,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:44,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:44,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:44,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c56a8077d900e7ab604cd2dd244d009f: Waiting for close lock at 1676318624338Running coprocessor pre-close hooks at 1676318624338Disabling compacts and flushes for region at 1676318624338Disabling writes for close at 1676318624338Writing region close event to WAL at 1676318624346 (+8 ms)Running coprocessor post-close hooks at 1676318624350 (+4 ms)Closed at 1676318624350 2023-02-13 20:03:44,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:44,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing da50b6856686e7920b340ad5aae1ad70, disabling compactions & flushes 2023-02-13 20:03:44,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:44,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:44,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. after waiting 0 ms 2023-02-13 20:03:44,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:44,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/da50b6856686e7920b340ad5aae1ad70/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 20:03:44,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:44,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for da50b6856686e7920b340ad5aae1ad70: Waiting for close lock at 1676318624351Running coprocessor pre-close hooks at 1676318624351Disabling compacts and flushes for region at 1676318624351Disabling writes for close at 1676318624351Writing region close event to WAL at 1676318624351Running coprocessor post-close hooks at 1676318624355 (+4 ms)Closed at 1676318624355 2023-02-13 20:03:44,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:44,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b12fe0deb333e53c3755e17b2405fb64, disabling compactions & flushes 2023-02-13 20:03:44,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:44,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:44,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. after waiting 0 ms 2023-02-13 20:03:44,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:44,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/namespace/4fe124c6119a7f92bad9e653b24cb046/.tmp/info/7b0a18b2492c4366adf2dd4f73a99a28 2023-02-13 20:03:44,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/namespace/4fe124c6119a7f92bad9e653b24cb046/.tmp/info/7b0a18b2492c4366adf2dd4f73a99a28 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/namespace/4fe124c6119a7f92bad9e653b24cb046/info/7b0a18b2492c4366adf2dd4f73a99a28 2023-02-13 20:03:44,367 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/.tmp/table/a02074ab62e14664b43663d9c0635790 2023-02-13 20:03:44,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:44,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:44,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b12fe0deb333e53c3755e17b2405fb64: Waiting for close lock at 1676318624356Running coprocessor pre-close hooks at 1676318624356Disabling compacts and flushes for region at 1676318624356Disabling writes for close at 1676318624356Writing region close event to WAL at 1676318624366 (+10 ms)Running coprocessor post-close hooks at 1676318624369 (+3 ms)Closed at 1676318624370 (+1 ms) 2023-02-13 20:03:44,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:44,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/namespace/4fe124c6119a7f92bad9e653b24cb046/info/7b0a18b2492c4366adf2dd4f73a99a28, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 20:03:44,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4fe124c6119a7f92bad9e653b24cb046 in 38ms, sequenceid=6, compaction requested=false 2023-02-13 20:03:44,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 20:03:44,375 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/.tmp/info/be64a95ad34546ed8544d280121f8eb6 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/info/be64a95ad34546ed8544d280121f8eb6 2023-02-13 20:03:44,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/namespace/4fe124c6119a7f92bad9e653b24cb046/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 20:03:44,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. 2023-02-13 20:03:44,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4fe124c6119a7f92bad9e653b24cb046: Waiting for close lock at 1676318624336Running coprocessor pre-close hooks at 1676318624336Disabling compacts and flushes for region at 1676318624336Disabling writes for close at 1676318624336Obtaining lock to block concurrent updates at 1676318624336Preparing flush snapshotting stores in 4fe124c6119a7f92bad9e653b24cb046 at 1676318624336Finished memstore snapshotting hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676318624336Flushing stores of hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. at 1676318624338 (+2 ms)Flushing 4fe124c6119a7f92bad9e653b24cb046/info: creating writer at 1676318624338Flushing 4fe124c6119a7f92bad9e653b24cb046/info: appending metadata at 1676318624348 (+10 ms)Flushing 4fe124c6119a7f92bad9e653b24cb046/info: closing flushed file at 1676318624348Flushing 4fe124c6119a7f92bad9e653b24cb046/info: reopening flushed file at 1676318624365 (+17 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 4fe124c6119a7f92bad9e653b24cb046 in 38ms, sequenceid=6, compaction requested=false at 1676318624374 (+9 ms)Writing region close event to WAL at 1676318624375 (+1 ms)Running coprocessor post-close hooks at 1676318624380 (+5 ms)Closed at 1676318624382 (+2 ms) 2023-02-13 20:03:44,382 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/info/be64a95ad34546ed8544d280121f8eb6, entries=110, sequenceid=32, filesize=18.7 K 2023-02-13 20:03:44,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676318619238.4fe124c6119a7f92bad9e653b24cb046. 2023-02-13 20:03:44,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 2c7e5559b6db0de5a50c0da024f986ad, disabling compactions & flushes 2023-02-13 20:03:44,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:44,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:44,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. after waiting 0 ms 2023-02-13 20:03:44,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:44,384 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/.tmp/table/a02074ab62e14664b43663d9c0635790 as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/table/a02074ab62e14664b43663d9c0635790 2023-02-13 20:03:44,386 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:44,387 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:44,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:44,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:44,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 2c7e5559b6db0de5a50c0da024f986ad: Waiting for close lock at 1676318624382Running coprocessor pre-close hooks at 1676318624382Disabling compacts and flushes for region at 1676318624382Disabling writes for close at 1676318624382Writing region close event to WAL at 1676318624383 (+1 ms)Running coprocessor post-close hooks at 1676318624389 (+6 ms)Closed at 1676318624389 2023-02-13 20:03:44,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:44,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 68ead255cc8f2f10aa4eb300d3a0a09f, disabling compactions & flushes 2023-02-13 20:03:44,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:44,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:44,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. after waiting 0 ms 2023-02-13 20:03:44,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:44,406 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/table/a02074ab62e14664b43663d9c0635790, entries=4, sequenceid=32, filesize=4.8 K 2023-02-13 20:03:44,413 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 101ms, sequenceid=32, compaction requested=false 2023-02-13 20:03:44,413 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 20:03:44,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:44,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:44,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 68ead255cc8f2f10aa4eb300d3a0a09f: Waiting for close lock at 1676318624389Running coprocessor pre-close hooks at 1676318624389Disabling compacts and flushes for region at 1676318624389Disabling writes for close at 1676318624389Writing region close event to WAL at 1676318624434 (+45 ms)Running coprocessor post-close hooks at 1676318624451 (+17 ms)Closed at 1676318624451 2023-02-13 20:03:44,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:44,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e31a9c7a57e83fa2ddec4114989acd99, disabling compactions & flushes 2023-02-13 20:03:44,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:44,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:44,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. after waiting 0 ms 2023-02-13 20:03:44,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:44,454 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-13 20:03:44,454 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 20:03:44,455 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:03:44,455 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318624308Running coprocessor pre-close hooks at 1676318624308Disabling compacts and flushes for region at 1676318624308Disabling writes for close at 1676318624312 (+4 ms)Obtaining lock to block concurrent updates at 1676318624314 (+2 ms)Preparing flush snapshotting stores in 1588230740 at 1676318624314Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676318624315 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676318624315Flushing 1588230740/info: creating writer at 1676318624315Flushing 1588230740/info: appending metadata at 1676318624319 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676318624319Flushing 1588230740/table: creating writer at 1676318624349 (+30 ms)Flushing 1588230740/table: appending metadata at 1676318624352 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676318624352Flushing 1588230740/info: reopening flushed file at 1676318624375 (+23 ms)Flushing 1588230740/table: reopening flushed file at 1676318624385 (+10 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 101ms, sequenceid=32, compaction requested=false at 1676318624413 (+28 ms)Writing region close event to WAL at 1676318624448 (+35 ms)Running coprocessor post-close hooks at 1676318624454 (+6 ms)Closed at 1676318624455 (+1 ms) 2023-02-13 20:03:44,455 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 20:03:44,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:44,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:44,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e31a9c7a57e83fa2ddec4114989acd99: Waiting for close lock at 1676318624451Running coprocessor pre-close hooks at 1676318624451Disabling compacts and flushes for region at 1676318624451Disabling writes for close at 1676318624452 (+1 ms)Writing region close event to WAL at 1676318624469 (+17 ms)Running coprocessor post-close hooks at 1676318624477 (+8 ms)Closed at 1676318624477 2023-02-13 20:03:44,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:44,511 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34961,1676318618521; all regions closed. 2023-02-13 20:03:44,513 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34825,1676318618565; all regions closed. 2023-02-13 20:03:44,519 DEBUG [RS:0;jenkins-hbase4:34961] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/oldWALs 2023-02-13 20:03:44,519 INFO [RS:0;jenkins-hbase4:34961] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34961%2C1676318618521.meta:.meta(num 1676318619156) 2023-02-13 20:03:44,519 DEBUG [RS:1;jenkins-hbase4:34825] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/oldWALs 2023-02-13 20:03:44,519 INFO [RS:1;jenkins-hbase4:34825] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34825%2C1676318618565:(num 1676318619643) 2023-02-13 20:03:44,519 DEBUG [RS:1;jenkins-hbase4:34825] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:44,519 INFO [RS:1;jenkins-hbase4:34825] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:44,520 INFO [RS:1;jenkins-hbase4:34825] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 20:03:44,520 INFO [RS:1;jenkins-hbase4:34825] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:03:44,520 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:03:44,520 INFO [RS:1;jenkins-hbase4:34825] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:03:44,520 INFO [RS:1;jenkins-hbase4:34825] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:03:44,521 INFO [RS:1;jenkins-hbase4:34825] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34825 2023-02-13 20:03:44,523 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:44,523 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,523 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34825,1676318618565 2023-02-13 20:03:44,523 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:44,523 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14d892aa rejected from java.util.concurrent.ThreadPoolExecutor@10e704e9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:44,523 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:44,523 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34674613 rejected from java.util.concurrent.ThreadPoolExecutor@10e704e9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:44,523 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34825,1676318618565] 2023-02-13 20:03:44,523 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34825,1676318618565; numProcessing=1 2023-02-13 20:03:44,525 DEBUG [RS:0;jenkins-hbase4:34961] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/oldWALs 2023-02-13 20:03:44,525 INFO [RS:0;jenkins-hbase4:34961] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34961%2C1676318618521:(num 1676318619902) 2023-02-13 20:03:44,525 DEBUG [RS:0;jenkins-hbase4:34961] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:44,525 INFO [RS:0;jenkins-hbase4:34961] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:44,525 INFO [RS:0;jenkins-hbase4:34961] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 20:03:44,525 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:03:44,526 INFO [RS:0;jenkins-hbase4:34961] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34961 2023-02-13 20:03:44,527 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34825,1676318618565 already deleted, retry=false 2023-02-13 20:03:44,527 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34825,1676318618565 expired; onlineServers=1 2023-02-13 20:03:44,530 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:44,530 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34961,1676318618521 2023-02-13 20:03:44,530 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@544ca964 rejected from java.util.concurrent.ThreadPoolExecutor@50733735[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:44,531 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34961,1676318618521] 2023-02-13 20:03:44,531 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34961,1676318618521; numProcessing=2 2023-02-13 20:03:44,533 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34961,1676318618521 already deleted, retry=false 2023-02-13 20:03:44,533 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34961,1676318618521 expired; onlineServers=0 2023-02-13 20:03:44,533 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39879,1676318618460' ***** 2023-02-13 20:03:44,533 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 20:03:44,534 DEBUG [M:0;jenkins-hbase4:39879] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e2b8d83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:03:44,534 INFO [M:0;jenkins-hbase4:39879] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39879,1676318618460 2023-02-13 20:03:44,534 INFO [M:0;jenkins-hbase4:39879] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39879,1676318618460; all regions closed. 2023-02-13 20:03:44,534 DEBUG [M:0;jenkins-hbase4:39879] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:44,534 DEBUG [M:0;jenkins-hbase4:39879] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 20:03:44,534 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 20:03:44,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318618771] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318618771,5,FailOnTimeoutGroup] 2023-02-13 20:03:44,534 DEBUG [M:0;jenkins-hbase4:39879] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 20:03:44,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318618771] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318618771,5,FailOnTimeoutGroup] 2023-02-13 20:03:44,535 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:44,535 INFO [M:0;jenkins-hbase4:39879] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 20:03:44,536 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:44,536 INFO [M:0;jenkins-hbase4:39879] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 20:03:44,536 INFO [M:0;jenkins-hbase4:39879] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 20:03:44,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:44,536 DEBUG [M:0;jenkins-hbase4:39879] master.HMaster(1502): Stopping service threads 2023-02-13 20:03:44,536 INFO [M:0;jenkins-hbase4:39879] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 20:03:44,537 ERROR [M:0;jenkins-hbase4:39879] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 20:03:44,537 INFO [M:0;jenkins-hbase4:39879] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 20:03:44,537 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 20:03:44,537 DEBUG [M:0;jenkins-hbase4:39879] zookeeper.ZKUtil(398): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 20:03:44,537 WARN [M:0;jenkins-hbase4:39879] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 20:03:44,537 INFO [M:0;jenkins-hbase4:39879] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 20:03:44,538 INFO [M:0;jenkins-hbase4:39879] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 20:03:44,538 DEBUG [M:0;jenkins-hbase4:39879] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:03:44,538 INFO [M:0;jenkins-hbase4:39879] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:44,538 DEBUG [M:0;jenkins-hbase4:39879] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:44,538 DEBUG [M:0;jenkins-hbase4:39879] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:03:44,538 DEBUG [M:0;jenkins-hbase4:39879] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:44,538 INFO [M:0;jenkins-hbase4:39879] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-13 20:03:44,551 INFO [M:0;jenkins-hbase4:39879] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/185194b1e47643b6b31982f098ae907a 2023-02-13 20:03:44,556 DEBUG [M:0;jenkins-hbase4:39879] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/185194b1e47643b6b31982f098ae907a as hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/185194b1e47643b6b31982f098ae907a 2023-02-13 20:03:44,560 INFO [M:0;jenkins-hbase4:39879] regionserver.HStore(1080): Added hdfs://localhost:45203/user/jenkins/test-data/7a8cd2fb-314b-21f5-22f5-5b35b3a725a8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/185194b1e47643b6b31982f098ae907a, entries=31, sequenceid=218, filesize=9.0 K 2023-02-13 20:03:44,561 INFO [M:0;jenkins-hbase4:39879] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=218, compaction requested=false 2023-02-13 20:03:44,562 INFO [M:0;jenkins-hbase4:39879] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:44,562 DEBUG [M:0;jenkins-hbase4:39879] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318624538Disabling compacts and flushes for region at 1676318624538Disabling writes for close at 1676318624538Obtaining lock to block concurrent updates at 1676318624538Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676318624538Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103362, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1676318624538Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676318624539 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676318624539Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676318624541 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676318624541Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676318624557 (+16 ms)Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=218, compaction requested=false at 1676318624561 (+4 ms)Writing region close event to WAL at 1676318624562 (+1 ms)Closed at 1676318624562 2023-02-13 20:03:44,566 INFO [M:0;jenkins-hbase4:39879] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 20:03:44,566 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:03:44,566 INFO [M:0;jenkins-hbase4:39879] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39879 2023-02-13 20:03:44,570 DEBUG [M:0;jenkins-hbase4:39879] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39879,1676318618460 already deleted, retry=false 2023-02-13 20:03:44,814 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:44,814 INFO [M:0;jenkins-hbase4:39879] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39879,1676318618460; zookeeper connection closed. 2023-02-13 20:03:44,814 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7f32012c rejected from java.util.concurrent.ThreadPoolExecutor@7b0d8a12[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:44,815 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): master:39879-0x1004f481d040000, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:44,815 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@60af0345 rejected from java.util.concurrent.ThreadPoolExecutor@7b0d8a12[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:44,914 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:44,914 INFO [RS:0;jenkins-hbase4:34961] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34961,1676318618521; zookeeper connection closed. 2023-02-13 20:03:44,914 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1518acc0 rejected from java.util.concurrent.ThreadPoolExecutor@50733735[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:44,914 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34961-0x1004f481d040001, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:44,914 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3350f923] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3350f923 2023-02-13 20:03:44,914 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d2d61b1 rejected from java.util.concurrent.ThreadPoolExecutor@50733735[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:45,014 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:45,014 INFO [RS:1;jenkins-hbase4:34825] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34825,1676318618565; zookeeper connection closed. 2023-02-13 20:03:45,015 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c124fdd rejected from java.util.concurrent.ThreadPoolExecutor@10e704e9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:45,015 DEBUG [Listener at localhost/35313-EventThread] zookeeper.ZKWatcher(600): regionserver:34825-0x1004f481d040002, quorum=127.0.0.1:53275, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:45,015 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5421a176] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5421a176 2023-02-13 20:03:45,015 ERROR [Listener at localhost/35313-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3b93e8aa rejected from java.util.concurrent.ThreadPoolExecutor@10e704e9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:45,015 INFO [Listener at localhost/35313] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 20:03:45,101 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/hadoop-1734236820849343191.jar 2023-02-13 20:03:45,106 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676318621326 type: FLUSH version: 2 ttl: 0 2023-02-13 20:03:45,107 DEBUG [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce 2023-02-13 20:03:45,107 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(239): region to add: c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:45,107 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(239): region to add: 32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:45,107 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(239): region to add: f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:45,108 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(239): region to add: 218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:45,108 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(239): region to add: f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:45,108 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(239): region to add: da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:45,108 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(239): region to add: 2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:45,108 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(239): region to add: 68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:45,108 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(239): region to add: e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:45,108 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(239): region to add: b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:45,108 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(585): clone region=c56a8077d900e7ab604cd2dd244d009f as c56a8077d900e7ab604cd2dd244d009f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:45,108 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(585): clone region=32a820bf08149a4bbdf760b6a28d8670 as 32a820bf08149a4bbdf760b6a28d8670 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:45,108 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(585): clone region=f8b5ff134a94a6f0cc543c9b3b8d77e1 as f8b5ff134a94a6f0cc543c9b3b8d77e1 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:45,109 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(585): clone region=218af36b91e3a190a3685972f43f3fb8 as 218af36b91e3a190a3685972f43f3fb8 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:45,109 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(585): clone region=f8e8200a41a8c68852aeae5c02624d12 as f8e8200a41a8c68852aeae5c02624d12 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:45,109 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(585): clone region=da50b6856686e7920b340ad5aae1ad70 as da50b6856686e7920b340ad5aae1ad70 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:45,109 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(585): clone region=2c7e5559b6db0de5a50c0da024f986ad as 2c7e5559b6db0de5a50c0da024f986ad in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:45,109 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(585): clone region=68ead255cc8f2f10aa4eb300d3a0a09f as 68ead255cc8f2f10aa4eb300d3a0a09f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:45,109 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(585): clone region=e31a9c7a57e83fa2ddec4114989acd99 as e31a9c7a57e83fa2ddec4114989acd99 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:45,109 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(585): clone region=b12fe0deb333e53c3755e17b2405fb64 as b12fe0deb333e53c3755e17b2405fb64 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 20:03:45,111 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 218af36b91e3a190a3685972f43f3fb8, NAME => 'testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452 2023-02-13 20:03:45,111 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => f8b5ff134a94a6f0cc543c9b3b8d77e1, NAME => 'testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452 2023-02-13 20:03:45,111 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 32a820bf08149a4bbdf760b6a28d8670, NAME => 'testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452 2023-02-13 20:03:45,111 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 68ead255cc8f2f10aa4eb300d3a0a09f, NAME => 'testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452 2023-02-13 20:03:45,111 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => f8e8200a41a8c68852aeae5c02624d12, NAME => 'testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452 2023-02-13 20:03:45,111 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 2c7e5559b6db0de5a50c0da024f986ad, NAME => 'testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452 2023-02-13 20:03:45,112 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => da50b6856686e7920b340ad5aae1ad70, NAME => 'testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452 2023-02-13 20:03:45,112 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => c56a8077d900e7ab604cd2dd244d009f, NAME => 'testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452 2023-02-13 20:03:45,140 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:45,141 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1a8be5bf5e1a4480acf9347c60535b25 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,143 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 91470194051d42eebb6f3f37526efd4c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,143 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:45,143 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:45,144 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f9e3c3208be64952bd9cc1c537774810 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,144 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 218af36b91e3a190a3685972f43f3fb8, disabling compactions & flushes 2023-02-13 20:03:45,144 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:45,144 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:45,144 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. after waiting 0 ms 2023-02-13 20:03:45,144 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:45,144 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:45,144 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 218af36b91e3a190a3685972f43f3fb8: Waiting for close lock at 1676318625144Disabling compacts and flushes for region at 1676318625144Disabling writes for close at 1676318625144Writing region close event to WAL at 1676318625144Closed at 1676318625144 2023-02-13 20:03:45,144 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => e31a9c7a57e83fa2ddec4114989acd99, NAME => 'testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452 2023-02-13 20:03:45,146 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing f8e8200a41a8c68852aeae5c02624d12, disabling compactions & flushes 2023-02-13 20:03:45,146 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:45,146 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:45,146 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. after waiting 0 ms 2023-02-13 20:03:45,146 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:45,146 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:45,146 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for f8e8200a41a8c68852aeae5c02624d12: Waiting for close lock at 1676318625146Disabling compacts and flushes for region at 1676318625146Disabling writes for close at 1676318625146Writing region close event to WAL at 1676318625146Closed at 1676318625146 2023-02-13 20:03:45,146 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => b12fe0deb333e53c3755e17b2405fb64, NAME => 'testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452 2023-02-13 20:03:45,146 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8a9359e40628496b93cabf9becdaaa32 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,152 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:45,152 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing da50b6856686e7920b340ad5aae1ad70, disabling compactions & flushes 2023-02-13 20:03:45,152 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:45,152 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:45,152 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. after waiting 0 ms 2023-02-13 20:03:45,152 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:45,153 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:45,153 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for da50b6856686e7920b340ad5aae1ad70: Waiting for close lock at 1676318625152Disabling compacts and flushes for region at 1676318625152Disabling writes for close at 1676318625152Writing region close event to WAL at 1676318625153 (+1 ms)Closed at 1676318625153 2023-02-13 20:03:45,154 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:45,154 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 02aecb8d7b7e4f5b92c1578b60e02c9c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 68ead255cc8f2f10aa4eb300d3a0a09f, disabling compactions & flushes 2023-02-13 20:03:45,156 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:45,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:45,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. after waiting 0 ms 2023-02-13 20:03:45,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:45,156 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:45,156 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 68ead255cc8f2f10aa4eb300d3a0a09f: Waiting for close lock at 1676318625156Disabling compacts and flushes for region at 1676318625156Disabling writes for close at 1676318625156Writing region close event to WAL at 1676318625156Closed at 1676318625156 2023-02-13 20:03:45,168 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5638c553eab94bf18315288ebb59dfee from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,176 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:45,176 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink edf67476be18482ca310e8e5ccd97881 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,177 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 32a820bf08149a4bbdf760b6a28d8670, disabling compactions & flushes 2023-02-13 20:03:45,177 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:45,177 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:45,177 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. after waiting 0 ms 2023-02-13 20:03:45,177 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:45,177 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:45,177 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 32a820bf08149a4bbdf760b6a28d8670: Waiting for close lock at 1676318625177Disabling compacts and flushes for region at 1676318625177Disabling writes for close at 1676318625177Writing region close event to WAL at 1676318625177Closed at 1676318625177 2023-02-13 20:03:45,177 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:45,177 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2f3f5e3d30d24b68b4e003d8b2b4e430 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,180 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:45,180 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ddf14f2900ea424aab251dd2499cf0ec from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,181 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 46d317a13912476b875c54f410d169bf from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,183 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 480e74d7b53b4b4c9c0e0150b54d4d66 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,183 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:45,183 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2bb05189657641799ca968dddcf52a80 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,188 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fdcc85131faf4b06af677660dbfd64db from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,188 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing c56a8077d900e7ab604cd2dd244d009f, disabling compactions & flushes 2023-02-13 20:03:45,189 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:45,189 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:45,189 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. after waiting 0 ms 2023-02-13 20:03:45,189 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:45,189 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:45,189 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for c56a8077d900e7ab604cd2dd244d009f: Waiting for close lock at 1676318625188Disabling compacts and flushes for region at 1676318625188Disabling writes for close at 1676318625189 (+1 ms)Writing region close event to WAL at 1676318625189Closed at 1676318625189 2023-02-13 20:03:45,190 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing f8b5ff134a94a6f0cc543c9b3b8d77e1, disabling compactions & flushes 2023-02-13 20:03:45,190 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:45,190 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:45,190 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. after waiting 0 ms 2023-02-13 20:03:45,190 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:45,190 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:45,190 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for f8b5ff134a94a6f0cc543c9b3b8d77e1: Waiting for close lock at 1676318625190Disabling compacts and flushes for region at 1676318625190Disabling writes for close at 1676318625190Writing region close event to WAL at 1676318625190Closed at 1676318625190 2023-02-13 20:03:45,190 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fdd0e46abfaf42968fad18fd8efde5a7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,190 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing e31a9c7a57e83fa2ddec4114989acd99, disabling compactions & flushes 2023-02-13 20:03:45,190 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:45,190 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:45,190 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. after waiting 0 ms 2023-02-13 20:03:45,191 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:45,191 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:45,191 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for e31a9c7a57e83fa2ddec4114989acd99: Waiting for close lock at 1676318625190Disabling compacts and flushes for region at 1676318625190Disabling writes for close at 1676318625191 (+1 ms)Writing region close event to WAL at 1676318625191Closed at 1676318625191 2023-02-13 20:03:45,192 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing b12fe0deb333e53c3755e17b2405fb64, disabling compactions & flushes 2023-02-13 20:03:45,192 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:45,192 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:45,192 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. after waiting 0 ms 2023-02-13 20:03:45,192 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:45,192 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:45,192 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for b12fe0deb333e53c3755e17b2405fb64: Waiting for close lock at 1676318625192Disabling compacts and flushes for region at 1676318625192Disabling writes for close at 1676318625192Writing region close event to WAL at 1676318625192Closed at 1676318625192 2023-02-13 20:03:45,581 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:45,581 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 78643beaf989446ea7111f7739dc86fa from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,584 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 916285bca7bf4075aaf9b7614d2fb81c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 20:03:45,586 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 2c7e5559b6db0de5a50c0da024f986ad, disabling compactions & flushes 2023-02-13 20:03:45,586 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:45,586 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:45,586 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. after waiting 0 ms 2023-02-13 20:03:45,586 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:45,586 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:45,586 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 2c7e5559b6db0de5a50c0da024f986ad: Waiting for close lock at 1676318625586Disabling compacts and flushes for region at 1676318625586Disabling writes for close at 1676318625586Writing region close event to WAL at 1676318625586Closed at 1676318625586 2023-02-13 20:03:45,586 INFO [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676318621326 type: FLUSH version: 2 ttl: 0 2023-02-13 20:03:45,587 DEBUG [Listener at localhost/35313] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452 2023-02-13 20:03:45,587 DEBUG [Listener at localhost/35313] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452 2023-02-13 20:03:45,587 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-data/ 2023-02-13 20:03:45,588 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |----default/ 2023-02-13 20:03:45,588 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 20:03:45,589 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |----------218af36b91e3a190a3685972f43f3fb8/ 2023-02-13 20:03:45,589 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:45,589 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |----------2c7e5559b6db0de5a50c0da024f986ad/ 2023-02-13 20:03:45,590 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:45,590 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:45,590 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=2c7e5559b6db0de5a50c0da024f986ad-78643beaf989446ea7111f7739dc86fa 2023-02-13 20:03:45,590 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:45,591 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=2c7e5559b6db0de5a50c0da024f986ad-916285bca7bf4075aaf9b7614d2fb81c 2023-02-13 20:03:45,591 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |----------32a820bf08149a4bbdf760b6a28d8670/ 2023-02-13 20:03:45,591 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:45,591 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:45,592 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=32a820bf08149a4bbdf760b6a28d8670-02aecb8d7b7e4f5b92c1578b60e02c9c 2023-02-13 20:03:45,592 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:45,592 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=32a820bf08149a4bbdf760b6a28d8670-5638c553eab94bf18315288ebb59dfee 2023-02-13 20:03:45,592 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |----------68ead255cc8f2f10aa4eb300d3a0a09f/ 2023-02-13 20:03:45,593 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:45,593 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:45,593 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=68ead255cc8f2f10aa4eb300d3a0a09f-f9e3c3208be64952bd9cc1c537774810 2023-02-13 20:03:45,593 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:45,594 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=68ead255cc8f2f10aa4eb300d3a0a09f-8a9359e40628496b93cabf9becdaaa32 2023-02-13 20:03:45,594 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |----------b12fe0deb333e53c3755e17b2405fb64/ 2023-02-13 20:03:45,594 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:45,594 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:45,595 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=b12fe0deb333e53c3755e17b2405fb64-2bb05189657641799ca968dddcf52a80 2023-02-13 20:03:45,595 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:45,595 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=b12fe0deb333e53c3755e17b2405fb64-fdd0e46abfaf42968fad18fd8efde5a7 2023-02-13 20:03:45,595 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |----------c56a8077d900e7ab604cd2dd244d009f/ 2023-02-13 20:03:45,596 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:45,596 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:45,596 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=c56a8077d900e7ab604cd2dd244d009f-edf67476be18482ca310e8e5ccd97881 2023-02-13 20:03:45,597 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:45,597 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=c56a8077d900e7ab604cd2dd244d009f-46d317a13912476b875c54f410d169bf 2023-02-13 20:03:45,597 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |----------da50b6856686e7920b340ad5aae1ad70/ 2023-02-13 20:03:45,598 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:45,598 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |----------e31a9c7a57e83fa2ddec4114989acd99/ 2023-02-13 20:03:45,598 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:45,598 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:45,598 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=e31a9c7a57e83fa2ddec4114989acd99-ddf14f2900ea424aab251dd2499cf0ec 2023-02-13 20:03:45,599 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:45,599 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=e31a9c7a57e83fa2ddec4114989acd99-fdcc85131faf4b06af677660dbfd64db 2023-02-13 20:03:45,599 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |----------f8b5ff134a94a6f0cc543c9b3b8d77e1/ 2023-02-13 20:03:45,599 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:45,599 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:45,600 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=f8b5ff134a94a6f0cc543c9b3b8d77e1-2f3f5e3d30d24b68b4e003d8b2b4e430 2023-02-13 20:03:45,600 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:45,600 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=f8b5ff134a94a6f0cc543c9b3b8d77e1-480e74d7b53b4b4c9c0e0150b54d4d66 2023-02-13 20:03:45,600 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |----------f8e8200a41a8c68852aeae5c02624d12/ 2023-02-13 20:03:45,601 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:45,601 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:45,601 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=f8e8200a41a8c68852aeae5c02624d12-1a8be5bf5e1a4480acf9347c60535b25 2023-02-13 20:03:45,601 DEBUG [Listener at localhost/35313] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:45,601 DEBUG [Listener at localhost/35313] util.CommonFSUtils(702): |----------------testWithMapReduce=f8e8200a41a8c68852aeae5c02624d12-91470194051d42eebb6f3f37526efd4c 2023-02-13 20:03:45,602 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,602 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,603 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,603 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,604 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,604 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,605 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,671 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/hadoop-2475745513713526545.jar 2023-02-13 20:03:45,672 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,672 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,673 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,673 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,673 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,674 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,674 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 20:03:45,674 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 20:03:45,675 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 20:03:45,675 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 20:03:45,675 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 20:03:45,676 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 20:03:45,676 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 20:03:45,677 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 20:03:45,677 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 20:03:45,677 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 20:03:45,678 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 20:03:45,678 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 20:03:45,678 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 20:03:45,679 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 20:03:45,679 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 20:03:45,745 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/hadoop-7887727291082074736.jar 2023-02-13 20:03:45,745 DEBUG [Listener at localhost/35313] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 20:03:45,751 WARN [Listener at localhost/35313] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 20:03:45,781 INFO [Listener at localhost/35313] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 20:03:45,874 WARN [Listener at localhost/35313] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/mapreduce.cluster.local.dir/1676318625844/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 20:03:45,875 WARN [Listener at localhost/35313] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/mapreduce.cluster.local.dir/1676318625844/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 20:03:45,909 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:45,909 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:45,910 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:45,912 INFO [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:45,914 DEBUG [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/218af36b91e3a190a3685972f43f3fb8/f1 2023-02-13 20:03:45,914 INFO [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 218af36b91e3a190a3685972f43f3fb8 columnFamilyName f1 2023-02-13 20:03:45,915 INFO [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] regionserver.HStore(310): Store=218af36b91e3a190a3685972f43f3fb8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:45,915 INFO [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 218af36b91e3a190a3685972f43f3fb8 2023-02-13 20:03:45,916 DEBUG [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/218af36b91e3a190a3685972f43f3fb8/f2 2023-02-13 20:03:45,916 INFO [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 218af36b91e3a190a3685972f43f3fb8 columnFamilyName f2 2023-02-13 20:03:45,917 INFO [StoreOpener-218af36b91e3a190a3685972f43f3fb8-1] regionserver.HStore(310): Store=218af36b91e3a190a3685972f43f3fb8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:45,917 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:45,917 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 218af36b91e3a190a3685972f43f3fb8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64877385, jitterRate=-0.033251628279685974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:45,917 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 218af36b91e3a190a3685972f43f3fb8: Writing region info on filesystem at 1676318625911Initializing all the Stores at 1676318625911Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318625912 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318625912Region opened successfully at 1676318625917 (+5 ms) 2023-02-13 20:03:45,934 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 218af36b91e3a190a3685972f43f3fb8, disabling compactions & flushes 2023-02-13 20:03:45,935 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:45,935 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:45,935 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. after waiting 0 ms 2023-02-13 20:03:45,935 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:45,935 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676318619984.218af36b91e3a190a3685972f43f3fb8. 2023-02-13 20:03:45,935 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 218af36b91e3a190a3685972f43f3fb8: Waiting for close lock at 1676318625934Disabling compacts and flushes for region at 1676318625934Disabling writes for close at 1676318625935 (+1 ms)Writing region close event to WAL at 1676318625935Closed at 1676318625935 2023-02-13 20:03:45,939 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:45,939 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:45,940 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:45,942 INFO [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:45,943 DEBUG [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f1 2023-02-13 20:03:45,943 INFO [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68ead255cc8f2f10aa4eb300d3a0a09f columnFamilyName f1 2023-02-13 20:03:45,948 DEBUG [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f1/testWithMapReduce=68ead255cc8f2f10aa4eb300d3a0a09f-f9e3c3208be64952bd9cc1c537774810 2023-02-13 20:03:45,948 INFO [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] regionserver.HStore(310): Store=68ead255cc8f2f10aa4eb300d3a0a09f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:45,948 INFO [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 68ead255cc8f2f10aa4eb300d3a0a09f 2023-02-13 20:03:45,949 DEBUG [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f2 2023-02-13 20:03:45,950 INFO [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68ead255cc8f2f10aa4eb300d3a0a09f columnFamilyName f2 2023-02-13 20:03:45,954 DEBUG [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/68ead255cc8f2f10aa4eb300d3a0a09f/f2/testWithMapReduce=68ead255cc8f2f10aa4eb300d3a0a09f-8a9359e40628496b93cabf9becdaaa32 2023-02-13 20:03:45,954 INFO [StoreOpener-68ead255cc8f2f10aa4eb300d3a0a09f-1] regionserver.HStore(310): Store=68ead255cc8f2f10aa4eb300d3a0a09f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:45,954 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:45,955 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 68ead255cc8f2f10aa4eb300d3a0a09f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64605229, jitterRate=-0.03730706870555878}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:45,955 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 68ead255cc8f2f10aa4eb300d3a0a09f: Writing region info on filesystem at 1676318625940Initializing all the Stores at 1676318625941 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318625941Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318625941Region opened successfully at 1676318625955 (+14 ms) 2023-02-13 20:03:45,993 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 68ead255cc8f2f10aa4eb300d3a0a09f, disabling compactions & flushes 2023-02-13 20:03:45,994 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:45,994 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:45,994 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. after waiting 0 ms 2023-02-13 20:03:45,994 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:45,995 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676318619984.68ead255cc8f2f10aa4eb300d3a0a09f. 2023-02-13 20:03:45,995 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 68ead255cc8f2f10aa4eb300d3a0a09f: Waiting for close lock at 1676318625993Disabling compacts and flushes for region at 1676318625993Disabling writes for close at 1676318625994 (+1 ms)Writing region close event to WAL at 1676318625995 (+1 ms)Closed at 1676318625995 2023-02-13 20:03:45,999 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:45,999 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:46,001 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:46,003 INFO [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:46,004 DEBUG [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f1 2023-02-13 20:03:46,004 INFO [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c56a8077d900e7ab604cd2dd244d009f columnFamilyName f1 2023-02-13 20:03:46,010 DEBUG [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f1/testWithMapReduce=c56a8077d900e7ab604cd2dd244d009f-edf67476be18482ca310e8e5ccd97881 2023-02-13 20:03:46,010 INFO [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] regionserver.HStore(310): Store=c56a8077d900e7ab604cd2dd244d009f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,010 INFO [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c56a8077d900e7ab604cd2dd244d009f 2023-02-13 20:03:46,011 DEBUG [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f2 2023-02-13 20:03:46,011 INFO [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c56a8077d900e7ab604cd2dd244d009f columnFamilyName f2 2023-02-13 20:03:46,016 DEBUG [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/c56a8077d900e7ab604cd2dd244d009f/f2/testWithMapReduce=c56a8077d900e7ab604cd2dd244d009f-46d317a13912476b875c54f410d169bf 2023-02-13 20:03:46,016 INFO [StoreOpener-c56a8077d900e7ab604cd2dd244d009f-1] regionserver.HStore(310): Store=c56a8077d900e7ab604cd2dd244d009f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,017 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:46,017 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c56a8077d900e7ab604cd2dd244d009f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59279815, jitterRate=-0.1166619211435318}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:46,017 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c56a8077d900e7ab604cd2dd244d009f: Writing region info on filesystem at 1676318626001Initializing all the Stores at 1676318626002 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626002Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626002Region opened successfully at 1676318626017 (+15 ms) 2023-02-13 20:03:46,051 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c56a8077d900e7ab604cd2dd244d009f, disabling compactions & flushes 2023-02-13 20:03:46,051 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:46,051 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:46,051 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. after waiting 0 ms 2023-02-13 20:03:46,051 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:46,052 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676318619984.c56a8077d900e7ab604cd2dd244d009f. 2023-02-13 20:03:46,052 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c56a8077d900e7ab604cd2dd244d009f: Waiting for close lock at 1676318626051Disabling compacts and flushes for region at 1676318626051Disabling writes for close at 1676318626051Writing region close event to WAL at 1676318626052 (+1 ms)Closed at 1676318626052 2023-02-13 20:03:46,057 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:46,057 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:46,058 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:46,060 INFO [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:46,061 DEBUG [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f1 2023-02-13 20:03:46,062 INFO [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c7e5559b6db0de5a50c0da024f986ad columnFamilyName f1 2023-02-13 20:03:46,066 DEBUG [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f1/testWithMapReduce=2c7e5559b6db0de5a50c0da024f986ad-78643beaf989446ea7111f7739dc86fa 2023-02-13 20:03:46,067 INFO [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] regionserver.HStore(310): Store=2c7e5559b6db0de5a50c0da024f986ad/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,067 INFO [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 2c7e5559b6db0de5a50c0da024f986ad 2023-02-13 20:03:46,068 DEBUG [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f2 2023-02-13 20:03:46,068 INFO [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c7e5559b6db0de5a50c0da024f986ad columnFamilyName f2 2023-02-13 20:03:46,072 DEBUG [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/2c7e5559b6db0de5a50c0da024f986ad/f2/testWithMapReduce=2c7e5559b6db0de5a50c0da024f986ad-916285bca7bf4075aaf9b7614d2fb81c 2023-02-13 20:03:46,072 INFO [StoreOpener-2c7e5559b6db0de5a50c0da024f986ad-1] regionserver.HStore(310): Store=2c7e5559b6db0de5a50c0da024f986ad/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,073 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:46,073 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 2c7e5559b6db0de5a50c0da024f986ad; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65793077, jitterRate=-0.019606754183769226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:46,073 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 2c7e5559b6db0de5a50c0da024f986ad: Writing region info on filesystem at 1676318626058Initializing all the Stores at 1676318626059 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626059Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626059Region opened successfully at 1676318626073 (+14 ms) 2023-02-13 20:03:46,117 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 2c7e5559b6db0de5a50c0da024f986ad, disabling compactions & flushes 2023-02-13 20:03:46,118 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:46,118 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:46,118 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. after waiting 0 ms 2023-02-13 20:03:46,118 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:46,119 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676318619984.2c7e5559b6db0de5a50c0da024f986ad. 2023-02-13 20:03:46,119 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 2c7e5559b6db0de5a50c0da024f986ad: Waiting for close lock at 1676318626117Disabling compacts and flushes for region at 1676318626117Disabling writes for close at 1676318626118 (+1 ms)Writing region close event to WAL at 1676318626119 (+1 ms)Closed at 1676318626119 2023-02-13 20:03:46,123 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:46,123 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:46,124 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:46,126 INFO [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:46,127 DEBUG [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f1 2023-02-13 20:03:46,128 INFO [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32a820bf08149a4bbdf760b6a28d8670 columnFamilyName f1 2023-02-13 20:03:46,135 DEBUG [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f1/testWithMapReduce=32a820bf08149a4bbdf760b6a28d8670-02aecb8d7b7e4f5b92c1578b60e02c9c 2023-02-13 20:03:46,135 INFO [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] regionserver.HStore(310): Store=32a820bf08149a4bbdf760b6a28d8670/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,135 INFO [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 32a820bf08149a4bbdf760b6a28d8670 2023-02-13 20:03:46,136 DEBUG [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f2 2023-02-13 20:03:46,137 INFO [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 32a820bf08149a4bbdf760b6a28d8670 columnFamilyName f2 2023-02-13 20:03:46,141 DEBUG [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/32a820bf08149a4bbdf760b6a28d8670/f2/testWithMapReduce=32a820bf08149a4bbdf760b6a28d8670-5638c553eab94bf18315288ebb59dfee 2023-02-13 20:03:46,141 INFO [StoreOpener-32a820bf08149a4bbdf760b6a28d8670-1] regionserver.HStore(310): Store=32a820bf08149a4bbdf760b6a28d8670/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,141 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:46,141 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 32a820bf08149a4bbdf760b6a28d8670; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67574369, jitterRate=0.006936565041542053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:46,142 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 32a820bf08149a4bbdf760b6a28d8670: Writing region info on filesystem at 1676318626125Initializing all the Stores at 1676318626125Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626126 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626126Region opened successfully at 1676318626141 (+15 ms) 2023-02-13 20:03:46,170 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 32a820bf08149a4bbdf760b6a28d8670, disabling compactions & flushes 2023-02-13 20:03:46,170 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:46,171 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:46,171 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. after waiting 0 ms 2023-02-13 20:03:46,171 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:46,172 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676318619984.32a820bf08149a4bbdf760b6a28d8670. 2023-02-13 20:03:46,172 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 32a820bf08149a4bbdf760b6a28d8670: Waiting for close lock at 1676318626170Disabling compacts and flushes for region at 1676318626170Disabling writes for close at 1676318626171 (+1 ms)Writing region close event to WAL at 1676318626172 (+1 ms)Closed at 1676318626172 2023-02-13 20:03:46,175 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:46,175 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:46,177 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:46,178 INFO [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:46,179 DEBUG [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f1 2023-02-13 20:03:46,180 INFO [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e31a9c7a57e83fa2ddec4114989acd99 columnFamilyName f1 2023-02-13 20:03:46,185 DEBUG [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f1/testWithMapReduce=e31a9c7a57e83fa2ddec4114989acd99-ddf14f2900ea424aab251dd2499cf0ec 2023-02-13 20:03:46,185 INFO [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] regionserver.HStore(310): Store=e31a9c7a57e83fa2ddec4114989acd99/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,185 INFO [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e31a9c7a57e83fa2ddec4114989acd99 2023-02-13 20:03:46,186 DEBUG [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f2 2023-02-13 20:03:46,186 INFO [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e31a9c7a57e83fa2ddec4114989acd99 columnFamilyName f2 2023-02-13 20:03:46,191 DEBUG [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/e31a9c7a57e83fa2ddec4114989acd99/f2/testWithMapReduce=e31a9c7a57e83fa2ddec4114989acd99-fdcc85131faf4b06af677660dbfd64db 2023-02-13 20:03:46,191 INFO [StoreOpener-e31a9c7a57e83fa2ddec4114989acd99-1] regionserver.HStore(310): Store=e31a9c7a57e83fa2ddec4114989acd99/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,191 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:46,191 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e31a9c7a57e83fa2ddec4114989acd99; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59920468, jitterRate=-0.10711544752120972}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:46,191 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e31a9c7a57e83fa2ddec4114989acd99: Writing region info on filesystem at 1676318626177Initializing all the Stores at 1676318626178 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626178Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626178Region opened successfully at 1676318626191 (+13 ms) 2023-02-13 20:03:46,221 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e31a9c7a57e83fa2ddec4114989acd99, disabling compactions & flushes 2023-02-13 20:03:46,221 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:46,221 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:46,221 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. after waiting 0 ms 2023-02-13 20:03:46,221 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:46,222 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676318619984.e31a9c7a57e83fa2ddec4114989acd99. 2023-02-13 20:03:46,222 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e31a9c7a57e83fa2ddec4114989acd99: Waiting for close lock at 1676318626221Disabling compacts and flushes for region at 1676318626221Disabling writes for close at 1676318626221Writing region close event to WAL at 1676318626222 (+1 ms)Closed at 1676318626222 2023-02-13 20:03:46,225 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:46,225 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:46,226 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:46,228 INFO [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:46,229 DEBUG [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f1 2023-02-13 20:03:46,229 INFO [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8b5ff134a94a6f0cc543c9b3b8d77e1 columnFamilyName f1 2023-02-13 20:03:46,234 DEBUG [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f1/testWithMapReduce=f8b5ff134a94a6f0cc543c9b3b8d77e1-2f3f5e3d30d24b68b4e003d8b2b4e430 2023-02-13 20:03:46,234 INFO [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] regionserver.HStore(310): Store=f8b5ff134a94a6f0cc543c9b3b8d77e1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,235 INFO [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8b5ff134a94a6f0cc543c9b3b8d77e1 2023-02-13 20:03:46,235 DEBUG [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f2 2023-02-13 20:03:46,236 INFO [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8b5ff134a94a6f0cc543c9b3b8d77e1 columnFamilyName f2 2023-02-13 20:03:46,240 DEBUG [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/f8b5ff134a94a6f0cc543c9b3b8d77e1/f2/testWithMapReduce=f8b5ff134a94a6f0cc543c9b3b8d77e1-480e74d7b53b4b4c9c0e0150b54d4d66 2023-02-13 20:03:46,241 INFO [StoreOpener-f8b5ff134a94a6f0cc543c9b3b8d77e1-1] regionserver.HStore(310): Store=f8b5ff134a94a6f0cc543c9b3b8d77e1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,241 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:46,241 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f8b5ff134a94a6f0cc543c9b3b8d77e1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71678189, jitterRate=0.06808824837207794}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:46,241 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f8b5ff134a94a6f0cc543c9b3b8d77e1: Writing region info on filesystem at 1676318626226Initializing all the Stores at 1676318626227 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626227Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626227Region opened successfully at 1676318626241 (+14 ms) 2023-02-13 20:03:46,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f8b5ff134a94a6f0cc543c9b3b8d77e1, disabling compactions & flushes 2023-02-13 20:03:46,268 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:46,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:46,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. after waiting 0 ms 2023-02-13 20:03:46,268 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:46,269 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676318619984.f8b5ff134a94a6f0cc543c9b3b8d77e1. 2023-02-13 20:03:46,269 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f8b5ff134a94a6f0cc543c9b3b8d77e1: Waiting for close lock at 1676318626268Disabling compacts and flushes for region at 1676318626268Disabling writes for close at 1676318626268Writing region close event to WAL at 1676318626269 (+1 ms)Closed at 1676318626269 2023-02-13 20:03:46,271 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:46,272 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:46,273 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:46,274 INFO [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:46,276 DEBUG [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/da50b6856686e7920b340ad5aae1ad70/f1 2023-02-13 20:03:46,276 INFO [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da50b6856686e7920b340ad5aae1ad70 columnFamilyName f1 2023-02-13 20:03:46,277 INFO [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] regionserver.HStore(310): Store=da50b6856686e7920b340ad5aae1ad70/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,277 INFO [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region da50b6856686e7920b340ad5aae1ad70 2023-02-13 20:03:46,278 DEBUG [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/da50b6856686e7920b340ad5aae1ad70/f2 2023-02-13 20:03:46,278 INFO [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region da50b6856686e7920b340ad5aae1ad70 columnFamilyName f2 2023-02-13 20:03:46,279 INFO [StoreOpener-da50b6856686e7920b340ad5aae1ad70-1] regionserver.HStore(310): Store=da50b6856686e7920b340ad5aae1ad70/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,279 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:46,279 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened da50b6856686e7920b340ad5aae1ad70; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71048529, jitterRate=0.05870558321475983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:46,279 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for da50b6856686e7920b340ad5aae1ad70: Writing region info on filesystem at 1676318626273Initializing all the Stores at 1676318626273Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626274 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626274Region opened successfully at 1676318626279 (+5 ms) 2023-02-13 20:03:46,308 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing da50b6856686e7920b340ad5aae1ad70, disabling compactions & flushes 2023-02-13 20:03:46,308 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:46,308 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:46,308 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. after waiting 0 ms 2023-02-13 20:03:46,308 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:46,308 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676318619984.da50b6856686e7920b340ad5aae1ad70. 2023-02-13 20:03:46,308 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for da50b6856686e7920b340ad5aae1ad70: Waiting for close lock at 1676318626308Disabling compacts and flushes for region at 1676318626308Disabling writes for close at 1676318626308Writing region close event to WAL at 1676318626308Closed at 1676318626308 2023-02-13 20:03:46,311 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:46,311 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:46,312 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:46,314 INFO [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:46,315 DEBUG [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f1 2023-02-13 20:03:46,316 INFO [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b12fe0deb333e53c3755e17b2405fb64 columnFamilyName f1 2023-02-13 20:03:46,321 DEBUG [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f1/testWithMapReduce=b12fe0deb333e53c3755e17b2405fb64-2bb05189657641799ca968dddcf52a80 2023-02-13 20:03:46,321 INFO [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] regionserver.HStore(310): Store=b12fe0deb333e53c3755e17b2405fb64/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,321 INFO [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b12fe0deb333e53c3755e17b2405fb64 2023-02-13 20:03:46,322 DEBUG [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f2 2023-02-13 20:03:46,322 INFO [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b12fe0deb333e53c3755e17b2405fb64 columnFamilyName f2 2023-02-13 20:03:46,327 DEBUG [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/b12fe0deb333e53c3755e17b2405fb64/f2/testWithMapReduce=b12fe0deb333e53c3755e17b2405fb64-fdd0e46abfaf42968fad18fd8efde5a7 2023-02-13 20:03:46,327 INFO [StoreOpener-b12fe0deb333e53c3755e17b2405fb64-1] regionserver.HStore(310): Store=b12fe0deb333e53c3755e17b2405fb64/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,327 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:46,327 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b12fe0deb333e53c3755e17b2405fb64; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66934363, jitterRate=-0.00260026752948761}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:46,327 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b12fe0deb333e53c3755e17b2405fb64: Writing region info on filesystem at 1676318626312Initializing all the Stores at 1676318626313 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626313Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626314 (+1 ms)Region opened successfully at 1676318626327 (+13 ms) 2023-02-13 20:03:46,354 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b12fe0deb333e53c3755e17b2405fb64, disabling compactions & flushes 2023-02-13 20:03:46,354 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:46,354 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:46,354 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. after waiting 0 ms 2023-02-13 20:03:46,354 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:46,355 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676318619984.b12fe0deb333e53c3755e17b2405fb64. 2023-02-13 20:03:46,355 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b12fe0deb333e53c3755e17b2405fb64: Waiting for close lock at 1676318626354Disabling compacts and flushes for region at 1676318626354Disabling writes for close at 1676318626354Writing region close event to WAL at 1676318626355 (+1 ms)Closed at 1676318626355 2023-02-13 20:03:46,361 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:46,361 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:46,362 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:46,365 INFO [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:46,366 DEBUG [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f1 2023-02-13 20:03:46,366 INFO [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8e8200a41a8c68852aeae5c02624d12 columnFamilyName f1 2023-02-13 20:03:46,372 DEBUG [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f1/testWithMapReduce=f8e8200a41a8c68852aeae5c02624d12-1a8be5bf5e1a4480acf9347c60535b25 2023-02-13 20:03:46,372 INFO [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] regionserver.HStore(310): Store=f8e8200a41a8c68852aeae5c02624d12/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,372 INFO [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f8e8200a41a8c68852aeae5c02624d12 2023-02-13 20:03:46,373 DEBUG [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f2 2023-02-13 20:03:46,374 INFO [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f8e8200a41a8c68852aeae5c02624d12 columnFamilyName f2 2023-02-13 20:03:46,379 DEBUG [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] regionserver.HStore(539): loaded hdfs://localhost:45203/user/jenkins/test-data/571636bb-dc54-f4b1-6db5-0bc6f131f9f1/testWithMapReduceAndOfflineHBaseMultiRegion/b959dff8-5813-4c9e-a90a-87be5cdef452/data/default/testWithMapReduce/f8e8200a41a8c68852aeae5c02624d12/f2/testWithMapReduce=f8e8200a41a8c68852aeae5c02624d12-91470194051d42eebb6f3f37526efd4c 2023-02-13 20:03:46,379 INFO [StoreOpener-f8e8200a41a8c68852aeae5c02624d12-1] regionserver.HStore(310): Store=f8e8200a41a8c68852aeae5c02624d12/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:46,379 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:46,380 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f8e8200a41a8c68852aeae5c02624d12; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65183528, jitterRate=-0.02868974208831787}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:46,380 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f8e8200a41a8c68852aeae5c02624d12: Writing region info on filesystem at 1676318626362Initializing all the Stores at 1676318626363 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626363Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318626364 (+1 ms)Region opened successfully at 1676318626380 (+16 ms) 2023-02-13 20:03:46,409 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f8e8200a41a8c68852aeae5c02624d12, disabling compactions & flushes 2023-02-13 20:03:46,409 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:46,409 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:46,409 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. after waiting 0 ms 2023-02-13 20:03:46,409 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:46,410 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676318619984.f8e8200a41a8c68852aeae5c02624d12. 2023-02-13 20:03:46,410 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f8e8200a41a8c68852aeae5c02624d12: Waiting for close lock at 1676318626409Disabling compacts and flushes for region at 1676318626409Disabling writes for close at 1676318626409Writing region close event to WAL at 1676318626410 (+1 ms)Closed at 1676318626410 2023-02-13 20:03:46,911 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 20:03:46,911 WARN [Listener at localhost/35313] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:03:46,915 INFO [Listener at localhost/35313] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:03:47,019 WARN [BP-9219306-172.31.14.131-1676318617720 heartbeating to localhost/127.0.0.1:45203] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 20:03:47,019 WARN [BP-9219306-172.31.14.131-1676318617720 heartbeating to localhost/127.0.0.1:45203] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-9219306-172.31.14.131-1676318617720 (Datanode Uuid 46b3881a-9a2b-4ec2-b715-4d2ed09b4c34) service to localhost/127.0.0.1:45203 2023-02-13 20:03:47,020 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/cluster_80b8dad7-f7d9-3d13-e07b-24d1c80445c4/dfs/data/data3/current/BP-9219306-172.31.14.131-1676318617720] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:03:47,020 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/cluster_80b8dad7-f7d9-3d13-e07b-24d1c80445c4/dfs/data/data4/current/BP-9219306-172.31.14.131-1676318617720] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:03:47,022 WARN [Listener at localhost/35313] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:03:47,030 INFO [Listener at localhost/35313] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:03:47,133 WARN [BP-9219306-172.31.14.131-1676318617720 heartbeating to localhost/127.0.0.1:45203] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 20:03:47,133 WARN [BP-9219306-172.31.14.131-1676318617720 heartbeating to localhost/127.0.0.1:45203] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-9219306-172.31.14.131-1676318617720 (Datanode Uuid c8e7c5ba-4585-4512-8f38-9da8c74d06a3) service to localhost/127.0.0.1:45203 2023-02-13 20:03:47,134 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/cluster_80b8dad7-f7d9-3d13-e07b-24d1c80445c4/dfs/data/data1/current/BP-9219306-172.31.14.131-1676318617720] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:03:47,134 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/cluster_80b8dad7-f7d9-3d13-e07b-24d1c80445c4/dfs/data/data2/current/BP-9219306-172.31.14.131-1676318617720] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:03:47,144 INFO [Listener at localhost/35313] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:03:47,164 INFO [Listener at localhost/35313] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 20:03:47,207 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 20:03:47,221 INFO [Listener at localhost/35313] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=153 (was 102) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45203 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:45203 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,39879,1676318618460)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:45203 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Listener at localhost/35313 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:45203 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:45203 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:45203 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:45203 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=534 (was 535), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=276 (was 252) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=1701 (was 1881) 2023-02-13 20:03:47,231 INFO [Listener at localhost/35313] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=153, OpenFileDescriptor=534, MaxFileDescriptor=60000, SystemLoadAverage=276, ProcessCount=166, AvailableMemoryMB=1700 2023-02-13 20:03:47,241 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/hadoop.log.dir so I do NOT create it in target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e 2023-02-13 20:03:47,241 WARN [Listener at localhost/35313] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 20:03:47,241 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/hadoop.tmp.dir so I do NOT create it in target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e 2023-02-13 20:03:47,242 WARN [Listener at localhost/35313] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/c739fd7d-25f6-a46d-8f41-7937c4b9ee22/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 20:03:47,242 DEBUG [Listener at localhost/35313] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e 2023-02-13 20:03:47,242 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 20:03:47,242 INFO [Listener at localhost/35313] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/cluster_8bd56495-3168-3dcd-8bdf-b53fee21a826, deleteOnExit=true 2023-02-13 20:03:47,242 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 20:03:47,242 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/test.cache.data in system properties and HBase conf 2023-02-13 20:03:47,242 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 20:03:47,242 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/hadoop.log.dir in system properties and HBase conf 2023-02-13 20:03:47,242 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 20:03:47,242 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 20:03:47,242 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 20:03:47,243 DEBUG [Listener at localhost/35313] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 20:03:47,243 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:03:47,243 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:03:47,243 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 20:03:47,243 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:03:47,243 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 20:03:47,243 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 20:03:47,243 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:03:47,243 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:03:47,244 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 20:03:47,244 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/nfs.dump.dir in system properties and HBase conf 2023-02-13 20:03:47,244 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/java.io.tmpdir in system properties and HBase conf 2023-02-13 20:03:47,244 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:03:47,244 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 20:03:47,244 INFO [Listener at localhost/35313] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 20:03:47,248 WARN [Listener at localhost/35313] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:03:47,248 WARN [Listener at localhost/35313] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:03:47,291 WARN [Listener at localhost/35313] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:03:47,293 INFO [Listener at localhost/35313] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:03:47,298 INFO [Listener at localhost/35313] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/java.io.tmpdir/Jetty_localhost_43321_hdfs____.3k23k3/webapp 2023-02-13 20:03:47,389 INFO [Listener at localhost/35313] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43321 2023-02-13 20:03:47,394 WARN [Listener at localhost/35313] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:03:47,394 WARN [Listener at localhost/35313] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:03:47,435 WARN [Listener at localhost/36729] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:03:47,450 WARN [Listener at localhost/36729] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:03:47,452 WARN [Listener at localhost/36729] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:03:47,453 INFO [Listener at localhost/36729] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:03:47,458 INFO [Listener at localhost/36729] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/java.io.tmpdir/Jetty_localhost_39757_datanode____disqje/webapp 2023-02-13 20:03:47,549 INFO [Listener at localhost/36729] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39757 2023-02-13 20:03:47,556 WARN [Listener at localhost/43679] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:03:47,571 WARN [Listener at localhost/43679] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:03:47,573 WARN [Listener at localhost/43679] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:03:47,574 INFO [Listener at localhost/43679] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:03:47,580 INFO [Listener at localhost/43679] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/java.io.tmpdir/Jetty_localhost_40019_datanode____w4zbyb/webapp 2023-02-13 20:03:47,662 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x686a6ddbe523405f: Processing first storage report for DS-c05761ea-ec30-480f-9573-db38c4fb4e6f from datanode fdf4ac65-1b4b-4319-9c52-16a9c3164a13 2023-02-13 20:03:47,662 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x686a6ddbe523405f: from storage DS-c05761ea-ec30-480f-9573-db38c4fb4e6f node DatanodeRegistration(127.0.0.1:35205, datanodeUuid=fdf4ac65-1b4b-4319-9c52-16a9c3164a13, infoPort=43385, infoSecurePort=0, ipcPort=43679, storageInfo=lv=-57;cid=testClusterID;nsid=332234786;c=1676318627251), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:47,662 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x686a6ddbe523405f: Processing first storage report for DS-70839e1a-5370-4bd9-a60e-cc56e77f1822 from datanode fdf4ac65-1b4b-4319-9c52-16a9c3164a13 2023-02-13 20:03:47,663 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x686a6ddbe523405f: from storage DS-70839e1a-5370-4bd9-a60e-cc56e77f1822 node DatanodeRegistration(127.0.0.1:35205, datanodeUuid=fdf4ac65-1b4b-4319-9c52-16a9c3164a13, infoPort=43385, infoSecurePort=0, ipcPort=43679, storageInfo=lv=-57;cid=testClusterID;nsid=332234786;c=1676318627251), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:47,680 INFO [Listener at localhost/43679] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40019 2023-02-13 20:03:47,688 WARN [Listener at localhost/43253] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:03:47,779 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb293b492bf9be7cb: Processing first storage report for DS-9c42fe0b-c3a1-490e-af93-d22b2d6bc6ed from datanode 6d661a83-0c46-4410-95fc-d60e3b3fdf9a 2023-02-13 20:03:47,779 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb293b492bf9be7cb: from storage DS-9c42fe0b-c3a1-490e-af93-d22b2d6bc6ed node DatanodeRegistration(127.0.0.1:45245, datanodeUuid=6d661a83-0c46-4410-95fc-d60e3b3fdf9a, infoPort=39897, infoSecurePort=0, ipcPort=43253, storageInfo=lv=-57;cid=testClusterID;nsid=332234786;c=1676318627251), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:47,779 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb293b492bf9be7cb: Processing first storage report for DS-64e7cd69-d6ec-4c06-9b76-253dd3f3b10f from datanode 6d661a83-0c46-4410-95fc-d60e3b3fdf9a 2023-02-13 20:03:47,779 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb293b492bf9be7cb: from storage DS-64e7cd69-d6ec-4c06-9b76-253dd3f3b10f node DatanodeRegistration(127.0.0.1:45245, datanodeUuid=6d661a83-0c46-4410-95fc-d60e3b3fdf9a, infoPort=39897, infoSecurePort=0, ipcPort=43253, storageInfo=lv=-57;cid=testClusterID;nsid=332234786;c=1676318627251), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:47,793 DEBUG [Listener at localhost/43253] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e 2023-02-13 20:03:47,795 INFO [Listener at localhost/43253] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/cluster_8bd56495-3168-3dcd-8bdf-b53fee21a826/zookeeper_0, clientPort=57579, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/cluster_8bd56495-3168-3dcd-8bdf-b53fee21a826/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/cluster_8bd56495-3168-3dcd-8bdf-b53fee21a826/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 20:03:47,796 INFO [Listener at localhost/43253] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57579 2023-02-13 20:03:47,796 INFO [Listener at localhost/43253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:47,797 INFO [Listener at localhost/43253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:47,809 INFO [Listener at localhost/43253] util.FSUtils(479): Created version file at hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d with version=8 2023-02-13 20:03:47,809 INFO [Listener at localhost/43253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:47,809 INFO [Listener at localhost/43253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:47,810 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36729/user/jenkins/test-data/f1db69a1-eda1-07d5-e0a9-dc1959f369a0/hbase-staging 2023-02-13 20:03:47,812 INFO [Listener at localhost/43253] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:03:47,812 INFO [Listener at localhost/43253] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:47,812 INFO [Listener at localhost/43253] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:47,812 INFO [Listener at localhost/43253] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:03:47,812 INFO [Listener at localhost/43253] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:47,812 INFO [Listener at localhost/43253] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:03:47,813 INFO [Listener at localhost/43253] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:03:47,814 INFO [Listener at localhost/43253] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42265 2023-02-13 20:03:47,814 INFO [Listener at localhost/43253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:47,815 INFO [Listener at localhost/43253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:47,816 INFO [Listener at localhost/43253] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42265 connecting to ZooKeeper ensemble=127.0.0.1:57579 2023-02-13 20:03:47,823 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:422650x0, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:03:47,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42265-0x1004f4841980000 connected 2023-02-13 20:03:47,842 DEBUG [Listener at localhost/43253] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:47,842 DEBUG [Listener at localhost/43253] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:47,843 DEBUG [Listener at localhost/43253] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:03:47,843 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42265 2023-02-13 20:03:47,844 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42265 2023-02-13 20:03:47,845 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42265 2023-02-13 20:03:47,848 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42265 2023-02-13 20:03:47,848 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42265 2023-02-13 20:03:47,848 INFO [Listener at localhost/43253] master.HMaster(439): hbase.rootdir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d, hbase.cluster.distributed=false 2023-02-13 20:03:47,862 INFO [Listener at localhost/43253] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:03:47,862 INFO [Listener at localhost/43253] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:47,862 INFO [Listener at localhost/43253] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:47,862 INFO [Listener at localhost/43253] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:03:47,862 INFO [Listener at localhost/43253] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:47,863 INFO [Listener at localhost/43253] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:03:47,863 INFO [Listener at localhost/43253] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:03:47,864 INFO [Listener at localhost/43253] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39645 2023-02-13 20:03:47,865 INFO [Listener at localhost/43253] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:03:47,866 DEBUG [Listener at localhost/43253] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:47,866 INFO [Listener at localhost/43253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:47,867 INFO [Listener at localhost/43253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:47,869 INFO [Listener at localhost/43253] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39645 connecting to ZooKeeper ensemble=127.0.0.1:57579 2023-02-13 20:03:47,873 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:396450x0, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:03:47,874 DEBUG [Listener at localhost/43253] zookeeper.ZKUtil(164): regionserver:396450x0, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:47,874 DEBUG [Listener at localhost/43253] zookeeper.ZKUtil(164): regionserver:396450x0, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:47,875 DEBUG [Listener at localhost/43253] zookeeper.ZKUtil(164): regionserver:396450x0, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:03:47,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39645-0x1004f4841980001 connected 2023-02-13 20:03:47,876 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39645 2023-02-13 20:03:47,877 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39645 2023-02-13 20:03:47,877 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39645 2023-02-13 20:03:47,884 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39645 2023-02-13 20:03:47,884 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39645 2023-02-13 20:03:47,895 INFO [Listener at localhost/43253] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:03:47,895 INFO [Listener at localhost/43253] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:47,895 INFO [Listener at localhost/43253] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:47,895 INFO [Listener at localhost/43253] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:03:47,895 INFO [Listener at localhost/43253] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:47,895 INFO [Listener at localhost/43253] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:03:47,896 INFO [Listener at localhost/43253] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:03:47,899 INFO [Listener at localhost/43253] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34391 2023-02-13 20:03:47,899 INFO [Listener at localhost/43253] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:03:47,900 DEBUG [Listener at localhost/43253] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:47,900 INFO [Listener at localhost/43253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:47,901 INFO [Listener at localhost/43253] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:47,902 INFO [Listener at localhost/43253] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34391 connecting to ZooKeeper ensemble=127.0.0.1:57579 2023-02-13 20:03:47,906 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:343910x0, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:03:47,909 DEBUG [Listener at localhost/43253] zookeeper.ZKUtil(164): regionserver:343910x0, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:47,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34391-0x1004f4841980002 connected 2023-02-13 20:03:47,909 DEBUG [Listener at localhost/43253] zookeeper.ZKUtil(164): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:47,910 DEBUG [Listener at localhost/43253] zookeeper.ZKUtil(164): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:03:47,911 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34391 2023-02-13 20:03:47,912 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34391 2023-02-13 20:03:47,914 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34391 2023-02-13 20:03:47,914 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34391 2023-02-13 20:03:47,916 DEBUG [Listener at localhost/43253] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34391 2023-02-13 20:03:47,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42265,1676318627812 2023-02-13 20:03:47,918 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:03:47,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42265,1676318627812 2023-02-13 20:03:47,921 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:47,921 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:47,921 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:47,921 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:47,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:03:47,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42265,1676318627812 from backup master directory 2023-02-13 20:03:47,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:03:47,924 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42265,1676318627812 2023-02-13 20:03:47,924 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:03:47,924 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:03:47,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,42265,1676318627812 2023-02-13 20:03:47,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/hbase.id with ID: cd195de0-573b-465a-b2e2-208b575924d9 2023-02-13 20:03:47,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:47,951 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:47,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x216cd758 to 127.0.0.1:57579 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:47,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bd20ae9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:47,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:47,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 20:03:47,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:47,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/data/master/store-tmp 2023-02-13 20:03:47,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:47,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:03:47,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:47,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:47,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:03:47,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:47,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:47,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318627980Disabling compacts and flushes for region at 1676318627980Disabling writes for close at 1676318627980Writing region close event to WAL at 1676318627980Closed at 1676318627980 2023-02-13 20:03:47,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/WALs/jenkins-hbase4.apache.org,42265,1676318627812 2023-02-13 20:03:47,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42265%2C1676318627812, suffix=, logDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/WALs/jenkins-hbase4.apache.org,42265,1676318627812, archiveDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/oldWALs, maxLogs=10 2023-02-13 20:03:48,005 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45245,DS-9c42fe0b-c3a1-490e-af93-d22b2d6bc6ed,DISK] 2023-02-13 20:03:48,005 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35205,DS-c05761ea-ec30-480f-9573-db38c4fb4e6f,DISK] 2023-02-13 20:03:48,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/WALs/jenkins-hbase4.apache.org,42265,1676318627812/jenkins-hbase4.apache.org%2C42265%2C1676318627812.1676318627985 2023-02-13 20:03:48,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45245,DS-9c42fe0b-c3a1-490e-af93-d22b2d6bc6ed,DISK], DatanodeInfoWithStorage[127.0.0.1:35205,DS-c05761ea-ec30-480f-9573-db38c4fb4e6f,DISK]] 2023-02-13 20:03:48,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:03:48,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:48,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:48,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:48,009 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:48,010 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 20:03:48,010 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 20:03:48,011 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:48,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:48,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:48,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:48,016 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:48,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73221936, jitterRate=0.09109187126159668}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:03:48,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676318628008Initializing all the Stores at 1676318628008Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318628008Cleaning up temporary data from old regions at 1676318628012 (+4 ms)Cleaning up detritus from prior splits at 1676318628013 (+1 ms)Region opened successfully at 1676318628017 (+4 ms) 2023-02-13 20:03:48,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 20:03:48,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 20:03:48,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 20:03:48,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 20:03:48,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 20:03:48,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 20:03:48,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 20:03:48,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 20:03:48,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 20:03:48,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 20:03:48,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 20:03:48,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 20:03:48,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 20:03:48,036 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 20:03:48,039 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:48,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 20:03:48,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 20:03:48,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 20:03:48,042 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:48,042 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:48,042 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:48,042 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:48,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,42265,1676318627812, sessionid=0x1004f4841980000, setting cluster-up flag (Was=false) 2023-02-13 20:03:48,046 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:48,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 20:03:48,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42265,1676318627812 2023-02-13 20:03:48,055 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:48,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 20:03:48,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42265,1676318627812 2023-02-13 20:03:48,060 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.hbase-snapshot/.tmp 2023-02-13 20:03:48,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 20:03:48,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:48,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:48,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:48,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:48,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 20:03:48,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:03:48,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676318658063 2023-02-13 20:03:48,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 20:03:48,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 20:03:48,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 20:03:48,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 20:03:48,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 20:03:48,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 20:03:48,064 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:03:48,064 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 20:03:48,065 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:48,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 20:03:48,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 20:03:48,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 20:03:48,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 20:03:48,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 20:03:48,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318628071,5,FailOnTimeoutGroup] 2023-02-13 20:03:48,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318628071,5,FailOnTimeoutGroup] 2023-02-13 20:03:48,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 20:03:48,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,079 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:48,080 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:48,080 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d 2023-02-13 20:03:48,086 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:48,087 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:03:48,089 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/info 2023-02-13 20:03:48,089 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:03:48,089 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:48,090 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:03:48,091 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:03:48,091 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:03:48,091 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:48,092 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:03:48,092 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/table 2023-02-13 20:03:48,093 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:03:48,093 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:48,094 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740 2023-02-13 20:03:48,094 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740 2023-02-13 20:03:48,095 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:03:48,096 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:03:48,098 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:48,098 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71168713, jitterRate=0.06049646437168121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:03:48,098 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676318628087Initializing all the Stores at 1676318628087Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318628087Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318628087Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318628087Cleaning up temporary data from old regions at 1676318628095 (+8 ms)Cleaning up detritus from prior splits at 1676318628095Region opened successfully at 1676318628098 (+3 ms) 2023-02-13 20:03:48,098 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:03:48,098 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:03:48,099 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:03:48,099 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:03:48,099 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:03:48,099 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:03:48,099 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318628098Disabling compacts and flushes for region at 1676318628098Disabling writes for close at 1676318628099 (+1 ms)Writing region close event to WAL at 1676318628099Closed at 1676318628099 2023-02-13 20:03:48,100 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:03:48,100 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 20:03:48,100 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 20:03:48,102 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 20:03:48,104 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 20:03:48,118 INFO [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(952): ClusterId : cd195de0-573b-465a-b2e2-208b575924d9 2023-02-13 20:03:48,118 INFO [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(952): ClusterId : cd195de0-573b-465a-b2e2-208b575924d9 2023-02-13 20:03:48,118 DEBUG [RS:0;jenkins-hbase4:39645] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:03:48,118 DEBUG [RS:1;jenkins-hbase4:34391] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:03:48,121 DEBUG [RS:0;jenkins-hbase4:39645] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:03:48,121 DEBUG [RS:0;jenkins-hbase4:39645] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:03:48,121 DEBUG [RS:1;jenkins-hbase4:34391] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:03:48,121 DEBUG [RS:1;jenkins-hbase4:34391] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:03:48,123 DEBUG [RS:0;jenkins-hbase4:39645] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:03:48,124 DEBUG [RS:0;jenkins-hbase4:39645] zookeeper.ReadOnlyZKClient(139): Connect 0x5c4bfeb3 to 127.0.0.1:57579 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:48,124 DEBUG [RS:1;jenkins-hbase4:34391] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:03:48,125 DEBUG [RS:1;jenkins-hbase4:34391] zookeeper.ReadOnlyZKClient(139): Connect 0x65b5cf50 to 127.0.0.1:57579 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:48,133 DEBUG [RS:0;jenkins-hbase4:39645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@528c0b4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:48,134 DEBUG [RS:0;jenkins-hbase4:39645] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56b395c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:03:48,134 DEBUG [RS:1;jenkins-hbase4:34391] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b722d96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:48,134 DEBUG [RS:1;jenkins-hbase4:34391] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f4da420, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:03:48,142 DEBUG [RS:0;jenkins-hbase4:39645] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39645 2023-02-13 20:03:48,142 INFO [RS:0;jenkins-hbase4:39645] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:03:48,142 INFO [RS:0;jenkins-hbase4:39645] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:03:48,142 DEBUG [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:03:48,143 INFO [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42265,1676318627812 with isa=jenkins-hbase4.apache.org/172.31.14.131:39645, startcode=1676318627862 2023-02-13 20:03:48,143 DEBUG [RS:0;jenkins-hbase4:39645] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:03:48,143 DEBUG [RS:1;jenkins-hbase4:34391] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34391 2023-02-13 20:03:48,143 INFO [RS:1;jenkins-hbase4:34391] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:03:48,143 INFO [RS:1;jenkins-hbase4:34391] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:03:48,143 DEBUG [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:03:48,144 INFO [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42265,1676318627812 with isa=jenkins-hbase4.apache.org/172.31.14.131:34391, startcode=1676318627895 2023-02-13 20:03:48,144 DEBUG [RS:1;jenkins-hbase4:34391] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:03:48,145 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49109, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:03:48,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:48,147 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58869, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:03:48,147 DEBUG [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d 2023-02-13 20:03:48,147 DEBUG [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36729 2023-02-13 20:03:48,147 DEBUG [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:03:48,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:48,148 DEBUG [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d 2023-02-13 20:03:48,148 DEBUG [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36729 2023-02-13 20:03:48,148 DEBUG [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:03:48,149 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:48,152 DEBUG [RS:0;jenkins-hbase4:39645] zookeeper.ZKUtil(162): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:48,153 WARN [RS:0;jenkins-hbase4:39645] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:03:48,153 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34391,1676318627895] 2023-02-13 20:03:48,153 INFO [RS:0;jenkins-hbase4:39645] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:48,153 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39645,1676318627862] 2023-02-13 20:03:48,153 DEBUG [RS:1;jenkins-hbase4:34391] zookeeper.ZKUtil(162): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:48,153 DEBUG [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/WALs/jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:48,153 WARN [RS:1;jenkins-hbase4:34391] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:03:48,153 INFO [RS:1;jenkins-hbase4:34391] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:48,153 DEBUG [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/WALs/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:48,157 DEBUG [RS:0;jenkins-hbase4:39645] zookeeper.ZKUtil(162): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:48,158 DEBUG [RS:1;jenkins-hbase4:34391] zookeeper.ZKUtil(162): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:48,158 DEBUG [RS:0;jenkins-hbase4:39645] zookeeper.ZKUtil(162): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:48,158 DEBUG [RS:1;jenkins-hbase4:34391] zookeeper.ZKUtil(162): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:48,158 DEBUG [RS:0;jenkins-hbase4:39645] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:03:48,159 DEBUG [RS:1;jenkins-hbase4:34391] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:03:48,159 INFO [RS:0;jenkins-hbase4:39645] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:03:48,159 INFO [RS:1;jenkins-hbase4:34391] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:03:48,160 INFO [RS:0;jenkins-hbase4:39645] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:03:48,163 INFO [RS:0;jenkins-hbase4:39645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:03:48,163 INFO [RS:1;jenkins-hbase4:34391] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:03:48,163 INFO [RS:0;jenkins-hbase4:39645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,163 INFO [RS:1;jenkins-hbase4:34391] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:03:48,163 INFO [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:03:48,163 INFO [RS:1;jenkins-hbase4:34391] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,164 INFO [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:03:48,164 INFO [RS:0;jenkins-hbase4:39645] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,165 DEBUG [RS:0;jenkins-hbase4:39645] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:0;jenkins-hbase4:39645] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 INFO [RS:1;jenkins-hbase4:34391] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,165 DEBUG [RS:0;jenkins-hbase4:39645] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:0;jenkins-hbase4:39645] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:1;jenkins-hbase4:34391] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:0;jenkins-hbase4:39645] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:1;jenkins-hbase4:34391] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:0;jenkins-hbase4:39645] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:03:48,165 DEBUG [RS:1;jenkins-hbase4:34391] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:0;jenkins-hbase4:39645] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:1;jenkins-hbase4:34391] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:0;jenkins-hbase4:39645] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:1;jenkins-hbase4:34391] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:0;jenkins-hbase4:39645] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:1;jenkins-hbase4:34391] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:03:48,165 DEBUG [RS:0;jenkins-hbase4:39645] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:1;jenkins-hbase4:34391] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:1;jenkins-hbase4:34391] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,165 DEBUG [RS:1;jenkins-hbase4:34391] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,166 DEBUG [RS:1;jenkins-hbase4:34391] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:48,166 INFO [RS:0;jenkins-hbase4:39645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,166 INFO [RS:0;jenkins-hbase4:39645] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,166 INFO [RS:0;jenkins-hbase4:39645] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,172 INFO [RS:1;jenkins-hbase4:34391] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,172 INFO [RS:1;jenkins-hbase4:34391] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,172 INFO [RS:1;jenkins-hbase4:34391] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,179 INFO [RS:0;jenkins-hbase4:39645] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:03:48,180 INFO [RS:0;jenkins-hbase4:39645] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39645,1676318627862-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,182 INFO [RS:1;jenkins-hbase4:34391] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:03:48,182 INFO [RS:1;jenkins-hbase4:34391] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34391,1676318627895-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,192 INFO [RS:0;jenkins-hbase4:39645] regionserver.Replication(203): jenkins-hbase4.apache.org,39645,1676318627862 started 2023-02-13 20:03:48,192 INFO [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39645,1676318627862, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39645, sessionid=0x1004f4841980001 2023-02-13 20:03:48,192 INFO [RS:1;jenkins-hbase4:34391] regionserver.Replication(203): jenkins-hbase4.apache.org,34391,1676318627895 started 2023-02-13 20:03:48,192 DEBUG [RS:0;jenkins-hbase4:39645] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:03:48,192 DEBUG [RS:0;jenkins-hbase4:39645] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:48,192 INFO [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34391,1676318627895, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34391, sessionid=0x1004f4841980002 2023-02-13 20:03:48,192 DEBUG [RS:0;jenkins-hbase4:39645] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39645,1676318627862' 2023-02-13 20:03:48,192 DEBUG [RS:1;jenkins-hbase4:34391] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:03:48,192 DEBUG [RS:1;jenkins-hbase4:34391] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:48,192 DEBUG [RS:1;jenkins-hbase4:34391] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34391,1676318627895' 2023-02-13 20:03:48,192 DEBUG [RS:1;jenkins-hbase4:34391] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:48,192 DEBUG [RS:0;jenkins-hbase4:39645] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:48,193 DEBUG [RS:1;jenkins-hbase4:34391] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:48,193 DEBUG [RS:0;jenkins-hbase4:39645] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:48,193 DEBUG [RS:1;jenkins-hbase4:34391] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:03:48,193 DEBUG [RS:0;jenkins-hbase4:39645] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:03:48,193 DEBUG [RS:0;jenkins-hbase4:39645] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:03:48,193 DEBUG [RS:1;jenkins-hbase4:34391] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:03:48,193 DEBUG [RS:1;jenkins-hbase4:34391] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:48,193 DEBUG [RS:1;jenkins-hbase4:34391] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34391,1676318627895' 2023-02-13 20:03:48,193 DEBUG [RS:0;jenkins-hbase4:39645] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:48,193 DEBUG [RS:0;jenkins-hbase4:39645] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39645,1676318627862' 2023-02-13 20:03:48,193 DEBUG [RS:0;jenkins-hbase4:39645] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:48,193 DEBUG [RS:1;jenkins-hbase4:34391] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:48,194 DEBUG [RS:0;jenkins-hbase4:39645] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:48,194 DEBUG [RS:1;jenkins-hbase4:34391] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:48,194 DEBUG [RS:0;jenkins-hbase4:39645] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:03:48,194 DEBUG [RS:1;jenkins-hbase4:34391] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:03:48,194 INFO [RS:1;jenkins-hbase4:34391] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:03:48,194 INFO [RS:0;jenkins-hbase4:39645] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:03:48,194 INFO [RS:0;jenkins-hbase4:39645] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:03:48,194 INFO [RS:1;jenkins-hbase4:34391] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:03:48,254 DEBUG [jenkins-hbase4:42265] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 20:03:48,254 DEBUG [jenkins-hbase4:42265] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:03:48,255 DEBUG [jenkins-hbase4:42265] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:03:48,256 DEBUG [jenkins-hbase4:42265] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:03:48,256 DEBUG [jenkins-hbase4:42265] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:03:48,256 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39645,1676318627862, state=OPENING 2023-02-13 20:03:48,258 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 20:03:48,259 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:48,259 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:03:48,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39645,1676318627862}] 2023-02-13 20:03:48,413 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:48,413 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 20:03:48,415 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51794, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 20:03:48,420 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 20:03:48,420 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:48,421 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39645%2C1676318627862.meta, suffix=.meta, logDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/WALs/jenkins-hbase4.apache.org,39645,1676318627862, archiveDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/oldWALs, maxLogs=32 2023-02-13 20:03:48,436 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35205,DS-c05761ea-ec30-480f-9573-db38c4fb4e6f,DISK] 2023-02-13 20:03:48,436 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45245,DS-9c42fe0b-c3a1-490e-af93-d22b2d6bc6ed,DISK] 2023-02-13 20:03:48,438 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/WALs/jenkins-hbase4.apache.org,39645,1676318627862/jenkins-hbase4.apache.org%2C39645%2C1676318627862.meta.1676318628422.meta 2023-02-13 20:03:48,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35205,DS-c05761ea-ec30-480f-9573-db38c4fb4e6f,DISK], DatanodeInfoWithStorage[127.0.0.1:45245,DS-9c42fe0b-c3a1-490e-af93-d22b2d6bc6ed,DISK]] 2023-02-13 20:03:48,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:03:48,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 20:03:48,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 20:03:48,439 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 20:03:48,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 20:03:48,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:48,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 20:03:48,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 20:03:48,441 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:03:48,442 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/info 2023-02-13 20:03:48,442 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/info 2023-02-13 20:03:48,442 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:03:48,442 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:48,443 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:03:48,443 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:03:48,444 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:03:48,444 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:03:48,444 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:48,444 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:03:48,445 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/table 2023-02-13 20:03:48,445 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/table 2023-02-13 20:03:48,445 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:03:48,446 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:48,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740 2023-02-13 20:03:48,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740 2023-02-13 20:03:48,449 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:03:48,450 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:03:48,451 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64217059, jitterRate=-0.04309125244617462}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:03:48,451 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676318628439Writing region info on filesystem at 1676318628439Initializing all the Stores at 1676318628440 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318628440Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318628440Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318628441 (+1 ms)Cleaning up temporary data from old regions at 1676318628448 (+7 ms)Cleaning up detritus from prior splits at 1676318628448Running coprocessor post-open hooks at 1676318628451 (+3 ms)Region opened successfully at 1676318628451 2023-02-13 20:03:48,451 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676318628413 2023-02-13 20:03:48,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 20:03:48,455 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 20:03:48,456 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39645,1676318627862, state=OPEN 2023-02-13 20:03:48,458 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 20:03:48,458 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:03:48,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 20:03:48,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39645,1676318627862 in 200 msec 2023-02-13 20:03:48,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 20:03:48,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 360 msec 2023-02-13 20:03:48,463 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 401 msec 2023-02-13 20:03:48,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676318627918, completionTime=-1 2023-02-13 20:03:48,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 20:03:48,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 20:03:48,467 DEBUG [hconnection-0x3f66abe3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:48,469 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51806, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:48,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 20:03:48,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676318688470 2023-02-13 20:03:48,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676318748470 2023-02-13 20:03:48,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-13 20:03:48,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42265,1676318627812-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42265,1676318627812-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42265,1676318627812-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42265, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:48,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 20:03:48,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:48,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 20:03:48,480 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 20:03:48,480 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:03:48,481 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:03:48,483 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/hbase/namespace/fb8e1f9a81808ff78e12b3c7f45303f7 2023-02-13 20:03:48,483 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/hbase/namespace/fb8e1f9a81808ff78e12b3c7f45303f7 empty. 2023-02-13 20:03:48,483 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/hbase/namespace/fb8e1f9a81808ff78e12b3c7f45303f7 2023-02-13 20:03:48,483 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 20:03:48,493 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:48,495 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => fb8e1f9a81808ff78e12b3c7f45303f7, NAME => 'hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp 2023-02-13 20:03:48,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:48,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing fb8e1f9a81808ff78e12b3c7f45303f7, disabling compactions & flushes 2023-02-13 20:03:48,501 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. 2023-02-13 20:03:48,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. 2023-02-13 20:03:48,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. after waiting 0 ms 2023-02-13 20:03:48,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. 2023-02-13 20:03:48,501 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. 2023-02-13 20:03:48,501 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for fb8e1f9a81808ff78e12b3c7f45303f7: Waiting for close lock at 1676318628501Disabling compacts and flushes for region at 1676318628501Disabling writes for close at 1676318628501Writing region close event to WAL at 1676318628501Closed at 1676318628501 2023-02-13 20:03:48,503 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:03:48,504 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318628504"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318628504"}]},"ts":"1676318628504"} 2023-02-13 20:03:48,506 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 20:03:48,507 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:03:48,507 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318628507"}]},"ts":"1676318628507"} 2023-02-13 20:03:48,508 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 20:03:48,516 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:03:48,516 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:03:48,516 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:03:48,516 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:03:48,517 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fb8e1f9a81808ff78e12b3c7f45303f7, ASSIGN}] 2023-02-13 20:03:48,519 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fb8e1f9a81808ff78e12b3c7f45303f7, ASSIGN 2023-02-13 20:03:48,519 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=fb8e1f9a81808ff78e12b3c7f45303f7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34391,1676318627895; forceNewPlan=false, retain=false 2023-02-13 20:03:48,670 INFO [jenkins-hbase4:42265] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 20:03:48,671 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fb8e1f9a81808ff78e12b3c7f45303f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:48,671 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318628671"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318628671"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318628671"}]},"ts":"1676318628671"} 2023-02-13 20:03:48,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure fb8e1f9a81808ff78e12b3c7f45303f7, server=jenkins-hbase4.apache.org,34391,1676318627895}] 2023-02-13 20:03:48,825 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:48,826 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 20:03:48,827 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48400, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 20:03:48,831 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. 2023-02-13 20:03:48,832 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34391%2C1676318627895, suffix=, logDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/WALs/jenkins-hbase4.apache.org,34391,1676318627895, archiveDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/oldWALs, maxLogs=32 2023-02-13 20:03:48,848 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45245,DS-9c42fe0b-c3a1-490e-af93-d22b2d6bc6ed,DISK] 2023-02-13 20:03:48,848 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35205,DS-c05761ea-ec30-480f-9573-db38c4fb4e6f,DISK] 2023-02-13 20:03:48,850 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/WALs/jenkins-hbase4.apache.org,34391,1676318627895/jenkins-hbase4.apache.org%2C34391%2C1676318627895.1676318628833 2023-02-13 20:03:48,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45245,DS-9c42fe0b-c3a1-490e-af93-d22b2d6bc6ed,DISK], DatanodeInfoWithStorage[127.0.0.1:35205,DS-c05761ea-ec30-480f-9573-db38c4fb4e6f,DISK]] 2023-02-13 20:03:48,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fb8e1f9a81808ff78e12b3c7f45303f7, NAME => 'hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:03:48,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace fb8e1f9a81808ff78e12b3c7f45303f7 2023-02-13 20:03:48,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:48,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fb8e1f9a81808ff78e12b3c7f45303f7 2023-02-13 20:03:48,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fb8e1f9a81808ff78e12b3c7f45303f7 2023-02-13 20:03:48,852 INFO [StoreOpener-fb8e1f9a81808ff78e12b3c7f45303f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region fb8e1f9a81808ff78e12b3c7f45303f7 2023-02-13 20:03:48,853 DEBUG [StoreOpener-fb8e1f9a81808ff78e12b3c7f45303f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/namespace/fb8e1f9a81808ff78e12b3c7f45303f7/info 2023-02-13 20:03:48,854 DEBUG [StoreOpener-fb8e1f9a81808ff78e12b3c7f45303f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/namespace/fb8e1f9a81808ff78e12b3c7f45303f7/info 2023-02-13 20:03:48,854 INFO [StoreOpener-fb8e1f9a81808ff78e12b3c7f45303f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb8e1f9a81808ff78e12b3c7f45303f7 columnFamilyName info 2023-02-13 20:03:48,854 INFO [StoreOpener-fb8e1f9a81808ff78e12b3c7f45303f7-1] regionserver.HStore(310): Store=fb8e1f9a81808ff78e12b3c7f45303f7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:48,855 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/namespace/fb8e1f9a81808ff78e12b3c7f45303f7 2023-02-13 20:03:48,855 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/namespace/fb8e1f9a81808ff78e12b3c7f45303f7 2023-02-13 20:03:48,857 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fb8e1f9a81808ff78e12b3c7f45303f7 2023-02-13 20:03:48,859 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/namespace/fb8e1f9a81808ff78e12b3c7f45303f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:48,859 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fb8e1f9a81808ff78e12b3c7f45303f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69682442, jitterRate=0.038349300622940063}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:03:48,860 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fb8e1f9a81808ff78e12b3c7f45303f7: Running coprocessor pre-open hook at 1676318628851Writing region info on filesystem at 1676318628851Initializing all the Stores at 1676318628852 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318628852Cleaning up temporary data from old regions at 1676318628856 (+4 ms)Cleaning up detritus from prior splits at 1676318628856Running coprocessor post-open hooks at 1676318628860 (+4 ms)Region opened successfully at 1676318628860 2023-02-13 20:03:48,860 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7., pid=6, masterSystemTime=1676318628825 2023-02-13 20:03:48,864 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. 2023-02-13 20:03:48,864 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. 2023-02-13 20:03:48,865 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fb8e1f9a81808ff78e12b3c7f45303f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:48,865 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318628864"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318628864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318628864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318628864"}]},"ts":"1676318628864"} 2023-02-13 20:03:48,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 20:03:48,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure fb8e1f9a81808ff78e12b3c7f45303f7, server=jenkins-hbase4.apache.org,34391,1676318627895 in 193 msec 2023-02-13 20:03:48,869 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 20:03:48,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=fb8e1f9a81808ff78e12b3c7f45303f7, ASSIGN in 351 msec 2023-02-13 20:03:48,870 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:03:48,870 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318628870"}]},"ts":"1676318628870"} 2023-02-13 20:03:48,872 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 20:03:48,874 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:03:48,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 396 msec 2023-02-13 20:03:48,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 20:03:48,881 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:03:48,881 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:48,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:48,885 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48406, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:48,886 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 20:03:48,894 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:03:48,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-13 20:03:48,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 20:03:48,914 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:03:48,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 11 msec 2023-02-13 20:03:48,932 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 20:03:48,934 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 20:03:48,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.010sec 2023-02-13 20:03:48,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 20:03:48,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 20:03:48,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 20:03:48,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42265,1676318627812-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 20:03:48,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42265,1676318627812-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 20:03:48,972 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 20:03:49,018 DEBUG [Listener at localhost/43253] zookeeper.ReadOnlyZKClient(139): Connect 0x65cc751a to 127.0.0.1:57579 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:49,024 DEBUG [Listener at localhost/43253] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49fcd42a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:49,025 DEBUG [hconnection-0x507ebe79-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:49,030 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51818, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:49,032 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42265,1676318627812 2023-02-13 20:03:49,033 DEBUG [Listener at localhost/43253] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 20:03:49,035 DEBUG [Listener at localhost/43253] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 20:03:49,036 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 20:03:49,037 INFO [Listener at localhost/43253] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:49,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:49,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 20:03:49,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 95 connection: 172.31.14.131:60988 deadline: 1676318689037, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:49,038 INFO [Listener at localhost/43253] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-13 20:03:49,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:49,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:49,043 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:03:49,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-13 20:03:49,044 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:03:49,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:49,046 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:49,046 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651 empty. 2023-02-13 20:03:49,047 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:49,047 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-13 20:03:49,059 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:49,060 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0f58ff38b5488b374d714530a4b54651, NAME => 'testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp 2023-02-13 20:03:49,067 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:49,067 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 0f58ff38b5488b374d714530a4b54651, disabling compactions & flushes 2023-02-13 20:03:49,067 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:49,067 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:49,067 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. after waiting 0 ms 2023-02-13 20:03:49,067 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:49,067 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:49,067 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 0f58ff38b5488b374d714530a4b54651: Waiting for close lock at 1676318629067Disabling compacts and flushes for region at 1676318629067Disabling writes for close at 1676318629067Writing region close event to WAL at 1676318629067Closed at 1676318629067 2023-02-13 20:03:49,069 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:03:49,070 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676318629070"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318629070"}]},"ts":"1676318629070"} 2023-02-13 20:03:49,071 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 20:03:49,072 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:03:49,072 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318629072"}]},"ts":"1676318629072"} 2023-02-13 20:03:49,073 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-13 20:03:49,078 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:03:49,078 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:03:49,078 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:03:49,079 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:03:49,079 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=0f58ff38b5488b374d714530a4b54651, ASSIGN}] 2023-02-13 20:03:49,080 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=0f58ff38b5488b374d714530a4b54651, ASSIGN 2023-02-13 20:03:49,081 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=0f58ff38b5488b374d714530a4b54651, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34391,1676318627895; forceNewPlan=false, retain=false 2023-02-13 20:03:49,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:49,196 INFO [RS:0;jenkins-hbase4:39645] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39645%2C1676318627862, suffix=, logDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/WALs/jenkins-hbase4.apache.org,39645,1676318627862, archiveDir=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/oldWALs, maxLogs=32 2023-02-13 20:03:49,210 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45245,DS-9c42fe0b-c3a1-490e-af93-d22b2d6bc6ed,DISK] 2023-02-13 20:03:49,210 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35205,DS-c05761ea-ec30-480f-9573-db38c4fb4e6f,DISK] 2023-02-13 20:03:49,212 INFO [RS:0;jenkins-hbase4:39645] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/WALs/jenkins-hbase4.apache.org,39645,1676318627862/jenkins-hbase4.apache.org%2C39645%2C1676318627862.1676318629197 2023-02-13 20:03:49,212 DEBUG [RS:0;jenkins-hbase4:39645] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45245,DS-9c42fe0b-c3a1-490e-af93-d22b2d6bc6ed,DISK], DatanodeInfoWithStorage[127.0.0.1:35205,DS-c05761ea-ec30-480f-9573-db38c4fb4e6f,DISK]] 2023-02-13 20:03:49,231 INFO [jenkins-hbase4:42265] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 20:03:49,232 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0f58ff38b5488b374d714530a4b54651, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,232 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676318629232"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318629232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318629232"}]},"ts":"1676318629232"} 2023-02-13 20:03:49,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 0f58ff38b5488b374d714530a4b54651, server=jenkins-hbase4.apache.org,34391,1676318627895}] 2023-02-13 20:03:49,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:49,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:49,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0f58ff38b5488b374d714530a4b54651, NAME => 'testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:03:49,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:49,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:49,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:49,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:49,391 INFO [StoreOpener-0f58ff38b5488b374d714530a4b54651-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:49,392 DEBUG [StoreOpener-0f58ff38b5488b374d714530a4b54651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f1 2023-02-13 20:03:49,392 DEBUG [StoreOpener-0f58ff38b5488b374d714530a4b54651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f1 2023-02-13 20:03:49,392 INFO [StoreOpener-0f58ff38b5488b374d714530a4b54651-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f58ff38b5488b374d714530a4b54651 columnFamilyName f1 2023-02-13 20:03:49,393 INFO [StoreOpener-0f58ff38b5488b374d714530a4b54651-1] regionserver.HStore(310): Store=0f58ff38b5488b374d714530a4b54651/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:49,393 INFO [StoreOpener-0f58ff38b5488b374d714530a4b54651-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:49,394 DEBUG [StoreOpener-0f58ff38b5488b374d714530a4b54651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f2 2023-02-13 20:03:49,394 DEBUG [StoreOpener-0f58ff38b5488b374d714530a4b54651-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f2 2023-02-13 20:03:49,394 INFO [StoreOpener-0f58ff38b5488b374d714530a4b54651-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f58ff38b5488b374d714530a4b54651 columnFamilyName f2 2023-02-13 20:03:49,395 INFO [StoreOpener-0f58ff38b5488b374d714530a4b54651-1] regionserver.HStore(310): Store=0f58ff38b5488b374d714530a4b54651/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:49,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:49,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:49,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:49,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:49,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:49,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0f58ff38b5488b374d714530a4b54651; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59882111, jitterRate=-0.10768701136112213}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:49,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0f58ff38b5488b374d714530a4b54651: Running coprocessor pre-open hook at 1676318629390Writing region info on filesystem at 1676318629390Initializing all the Stores at 1676318629390Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318629390Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318629390Cleaning up temporary data from old regions at 1676318629396 (+6 ms)Cleaning up detritus from prior splits at 1676318629397 (+1 ms)Running coprocessor post-open hooks at 1676318629401 (+4 ms)Region opened successfully at 1676318629401 2023-02-13 20:03:49,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651., pid=12, masterSystemTime=1676318629386 2023-02-13 20:03:49,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:49,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:49,404 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=0f58ff38b5488b374d714530a4b54651, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,404 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676318629404"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318629404"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318629404"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318629404"}]},"ts":"1676318629404"} 2023-02-13 20:03:49,407 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 20:03:49,407 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 0f58ff38b5488b374d714530a4b54651, server=jenkins-hbase4.apache.org,34391,1676318627895 in 172 msec 2023-02-13 20:03:49,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 20:03:49,408 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=0f58ff38b5488b374d714530a4b54651, ASSIGN in 328 msec 2023-02-13 20:03:49,409 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:03:49,409 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318629409"}]},"ts":"1676318629409"} 2023-02-13 20:03:49,410 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-13 20:03:49,412 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:03:49,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 372 msec 2023-02-13 20:03:49,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:49,650 INFO [Listener at localhost/43253] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-13 20:03:49,651 DEBUG [Listener at localhost/43253] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-13 20:03:49,651 INFO [Listener at localhost/43253] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:03:49,653 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-13 20:03:49,653 INFO [Listener at localhost/43253] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:03:49,653 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-13 20:03:49,653 INFO [Listener at localhost/43253] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 20:03:49,676 DEBUG [hconnection-0x507ebe79-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:49,696 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48408, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:49,709 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34391] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:49,820 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 20:03:49,837 INFO [Listener at localhost/43253] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 20:03:49,838 INFO [Listener at localhost/43253] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 20:03:49,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 20:03:49,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676318629840 (current time:1676318629840). 2023-02-13 20:03:49,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 20:03:49,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] zookeeper.ReadOnlyZKClient(139): Connect 0x02f379b9 to 127.0.0.1:57579 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:49,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@353587de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:49,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:49,854 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51826, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:49,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02f379b9 to 127.0.0.1:57579 2023-02-13 20:03:49,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:49,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 20:03:49,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 20:03:49,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 20:03:49,863 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 20:03:49,864 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676319229864 2023-02-13 20:03:49,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 20:03:49,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:49,865 DEBUG [Listener at localhost/43253] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 20:03:49,866 DEBUG [Listener at localhost/43253] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 20:03:49,866 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 20:03:49,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 20:03:49,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 6 msec 2023-02-13 20:03:49,872 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 20:03:49,873 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676319229873 2023-02-13 20:03:49,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-13 20:03:49,900 INFO [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-13 20:03:49,900 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:03:49,901 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-13 20:03:49,901 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-13 20:03:49,901 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 20:03:49,902 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-13 20:03:49,903 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:49,903 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:49,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:49,903 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:49,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 20:03:49,904 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,904 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:03:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 20:03:49,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 20:03:49,904 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 20:03:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-13 20:03:49,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 20:03:49,904 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-13 20:03:49,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-13 20:03:49,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 20:03:49,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 20:03:49,905 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-13 20:03:49,905 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 20:03:49,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 20:03:49,905 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:03:49,906 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 20:03:49,906 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 20:03:49,906 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 20:03:49,906 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:03:49,906 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39645,1676318627862' joining acquired barrier for procedure (foo) in zk 2023-02-13 20:03:49,906 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 20:03:49,906 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 20:03:49,906 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34391,1676318627895' joining acquired barrier for procedure (foo) in zk 2023-02-13 20:03:49,908 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,908 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 20:03:49,908 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 20:03:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:49,909 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 20:03:49,909 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:49,909 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 20:03:49,909 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:49,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 20:03:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:49,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:49,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34391,1676318627895' joining acquired barrier for procedure 'foo' on coordinator 2023-02-13 20:03:49,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19d6fe60[Count = 0] remaining members to acquire global barrier 2023-02-13 20:03:49,911 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-13 20:03:49,911 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-13 20:03:49,912 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 20:03:49,912 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 20:03:49,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 20:03:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 20:03:49,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 20:03:49,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 20:03:49,912 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,912 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:03:49,912 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 20:03:49,912 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 20:03:49,912 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 20:03:49,912 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,39645,1676318627862' in zk 2023-02-13 20:03:49,915 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 20:03:49,915 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:49,915 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 20:03:49,921 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 20:03:49,921 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 20:03:49,921 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:49,921 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. started... 2023-02-13 20:03:49,922 INFO [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0f58ff38b5488b374d714530a4b54651 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 20:03:49,940 INFO [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/.tmp/f1/0105c64ec1ef4f80a9f1a2309ed64a16 2023-02-13 20:03:49,959 INFO [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/.tmp/f2/05dcb6adff564df39cdc99b8773b93a3 2023-02-13 20:03:49,965 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/.tmp/f1/0105c64ec1ef4f80a9f1a2309ed64a16 as hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f1/0105c64ec1ef4f80a9f1a2309ed64a16 2023-02-13 20:03:49,966 DEBUG [Listener at localhost/43253] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:49,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-13 20:03:49,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:03:49,967 DEBUG [Listener at localhost/43253] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 20:03:49,970 INFO [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f1/0105c64ec1ef4f80a9f1a2309ed64a16, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 20:03:49,971 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/.tmp/f2/05dcb6adff564df39cdc99b8773b93a3 as hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f2/05dcb6adff564df39cdc99b8773b93a3 2023-02-13 20:03:49,975 INFO [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f2/05dcb6adff564df39cdc99b8773b93a3, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 20:03:49,976 INFO [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 0f58ff38b5488b374d714530a4b54651 in 54ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:49,976 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-13 20:03:49,976 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0f58ff38b5488b374d714530a4b54651: 2023-02-13 20:03:49,976 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.' region-info for snapshot=foo 2023-02-13 20:03:49,976 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:49,976 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f1/0105c64ec1ef4f80a9f1a2309ed64a16] hfiles 2023-02-13 20:03:49,976 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f1/0105c64ec1ef4f80a9f1a2309ed64a16 for snapshot=foo 2023-02-13 20:03:49,977 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f2/05dcb6adff564df39cdc99b8773b93a3] hfiles 2023-02-13 20:03:49,977 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f2/05dcb6adff564df39cdc99b8773b93a3 for snapshot=foo 2023-02-13 20:03:49,982 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. completed. 2023-02-13 20:03:49,982 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:49,982 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 20:03:49,982 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 20:03:49,982 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,982 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 20:03:49,982 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34391,1676318627895' in zk 2023-02-13 20:03:49,984 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,984 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 20:03:49,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:49,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:49,984 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:49,984 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 20:03:49,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:49,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:49,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 20:03:49,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:49,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:49,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 20:03:49,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:49,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,34391,1676318627895': 2023-02-13 20:03:49,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34391,1676318627895' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-13 20:03:49,988 INFO [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-13 20:03:49,988 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:03:49,988 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:03:49,988 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-13 20:03:49,988 INFO [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 20:03:49,990 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 20:03:49,990 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 20:03:49,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-13 20:03:49,990 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:49,990 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 20:03:49,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:49,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:49,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 20:03:49,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 20:03:49,990 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:49,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 20:03:49,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 20:03:49,990 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:49,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:49,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:49,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:49,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:49,991 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:49,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 20:03:49,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 20:03:49,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 20:03:49,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:49,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 20:03:49,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:49,992 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:49,993 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:49,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 20:03:49,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:49,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:49,998 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:49,998 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:49,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:49,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:49,999 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:49,998 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:49,998 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:49,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-13 20:03:49,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-13 20:03:49,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:49,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:49,999 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:49,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:49,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:49,999 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 20:03:50,001 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,001 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 20:03:50,001 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:50,001 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 20:03:50,001 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,001 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 20:03:50,001 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 20:03:50,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.hbase-snapshot/.tmp/foo 2023-02-13 20:03:50,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:50,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:50,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.hbase-snapshot/.tmp/foo to hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.hbase-snapshot/foo 2023-02-13 20:03:50,041 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-13 20:03:50,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.hbase-snapshot/.tmp/foo 2023-02-13 20:03:50,041 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.hbase-snapshot/.tmp/foo 2023-02-13 20:03:50,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676318629864Consolidate snapshot: foo at 1676318629999 (+135 ms)Loading Region manifests for foo at 1676318629999Writing data manifest for foo at 1676318630004 (+5 ms)Verifying snapshot: foo at 1676318630012 (+8 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676318630041 (+29 ms) 2023-02-13 20:03:50,043 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 20:03:50,044 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 178 msec 2023-02-13 20:03:50,167 DEBUG [Listener at localhost/43253] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:50,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-13 20:03:50,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 20:03:50,169 INFO [Listener at localhost/43253] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 20:03:50,174 INFO [Listener at localhost/43253] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 20:03:50,179 INFO [Listener at localhost/43253] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 20:03:50,218 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34391] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:50,302 INFO [Listener at localhost/43253] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 20:03:50,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 20:03:50,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,310 INFO [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-13 20:03:50,310 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:03:50,311 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-13 20:03:50,311 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-13 20:03:50,312 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,312 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,313 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,313 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:50,313 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:50,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:50,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:50,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:50,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:50,313 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,313 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:03:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:03:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,314 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:03:50,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,315 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,315 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-13 20:03:50,315 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-13 20:03:50,315 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:03:50,315 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:03:50,316 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-13 20:03:50,316 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-13 20:03:50,316 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39645,1676318627862' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-13 20:03:50,316 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-13 20:03:50,316 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 20:03:50,316 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 20:03:50,316 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:50,316 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. started... 2023-02-13 20:03:50,317 INFO [rs(jenkins-hbase4.apache.org,34391,1676318627895)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0f58ff38b5488b374d714530a4b54651 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 20:03:50,317 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,318 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,318 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:50,339 INFO [rs(jenkins-hbase4.apache.org,34391,1676318627895)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/.tmp/f1/2946031ae3024c2f88dc9253096e9a2d 2023-02-13 20:03:50,759 INFO [rs(jenkins-hbase4.apache.org,34391,1676318627895)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/.tmp/f2/4eccee10f4174569b1b4fbc6507ec57d 2023-02-13 20:03:50,764 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/.tmp/f1/2946031ae3024c2f88dc9253096e9a2d as hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f1/2946031ae3024c2f88dc9253096e9a2d 2023-02-13 20:03:50,768 INFO [rs(jenkins-hbase4.apache.org,34391,1676318627895)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f1/2946031ae3024c2f88dc9253096e9a2d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 20:03:50,769 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/.tmp/f2/4eccee10f4174569b1b4fbc6507ec57d as hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f2/4eccee10f4174569b1b4fbc6507ec57d 2023-02-13 20:03:50,774 INFO [rs(jenkins-hbase4.apache.org,34391,1676318627895)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f2/4eccee10f4174569b1b4fbc6507ec57d, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 20:03:50,775 INFO [rs(jenkins-hbase4.apache.org,34391,1676318627895)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 0f58ff38b5488b374d714530a4b54651 in 457ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:50,775 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0f58ff38b5488b374d714530a4b54651: 2023-02-13 20:03:50,776 DEBUG [rs(jenkins-hbase4.apache.org,34391,1676318627895)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:50,776 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 20:03:50,776 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 20:03:50,776 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,776 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-13 20:03:50,776 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34391,1676318627895' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-13 20:03:50,780 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,780 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:50,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:50,780 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,780 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:50,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:50,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:50,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:50,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:50,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34391,1676318627895' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-13 20:03:50,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1de97982[Count = 0] remaining members to acquire global barrier 2023-02-13 20:03:50,782 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-13 20:03:50,782 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,783 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,783 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,783 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,783 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-13 20:03:50,783 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-13 20:03:50,783 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:03:50,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,783 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,34391,1676318627895' in zk 2023-02-13 20:03:50,783 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-13 20:03:50,783 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-13 20:03:50,783 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,39645,1676318627862' in zk 2023-02-13 20:03:50,785 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-13 20:03:50,785 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,785 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:50,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:50,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:50,785 DEBUG [member: 'jenkins-hbase4.apache.org,34391,1676318627895' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-13 20:03:50,785 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-13 20:03:50,785 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:50,785 DEBUG [member: 'jenkins-hbase4.apache.org,39645,1676318627862' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-13 20:03:50,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:50,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:50,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:50,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:50,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:50,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,34391,1676318627895': 2023-02-13 20:03:50,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34391,1676318627895' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-13 20:03:50,789 INFO [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-13 20:03:50,789 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:03:50,789 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:03:50,789 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,789 INFO [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 20:03:50,791 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,791 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:50,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:50,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,791 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,792 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:50,792 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:50,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:50,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:50,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:50,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:50,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:50,792 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:50,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,793 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:50,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:50,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:50,794 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,794 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:50,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:50,797 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:50,797 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:50,797 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:50,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:50,797 DEBUG [(jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:50,797 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:50,797 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:50,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-13 20:03:50,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 20:03:50,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:50,797 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:50,798 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,798 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:50,798 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:50,798 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,798 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:50,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:50,798 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,798 DEBUG [Listener at localhost/43253] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-13 20:03:50,798 DEBUG [Listener at localhost/43253] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 20:03:50,798 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,899 DEBUG [Listener at localhost/43253] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 20:03:50,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 20:03:50,905 INFO [Listener at localhost/43253] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676318629840 type: FLUSH version: 2 ttl: 0 2023-02-13 20:03:50,905 DEBUG [Listener at localhost/43253] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36729/user/jenkins/test-data/f1db69a1-eda1-07d5-e0a9-dc1959f369a0/foo/74360339-158b-4e3c-be2d-55ca862442dd/data/default/testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,905 INFO [Listener at localhost/43253] snapshot.RestoreSnapshotHelper(239): region to add: 0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:50,905 INFO [Listener at localhost/43253] snapshot.RestoreSnapshotHelper(585): clone region=0f58ff38b5488b374d714530a4b54651 as 0f58ff38b5488b374d714530a4b54651 in snapshot foo 2023-02-13 20:03:50,906 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0f58ff38b5488b374d714530a4b54651, NAME => 'testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36729/user/jenkins/test-data/f1db69a1-eda1-07d5-e0a9-dc1959f369a0/foo/74360339-158b-4e3c-be2d-55ca862442dd 2023-02-13 20:03:50,912 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:50,913 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0105c64ec1ef4f80a9f1a2309ed64a16 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,915 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 05dcb6adff564df39cdc99b8773b93a3 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,916 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 0f58ff38b5488b374d714530a4b54651, disabling compactions & flushes 2023-02-13 20:03:50,916 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:50,916 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:50,917 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. after waiting 0 ms 2023-02-13 20:03:50,917 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:50,917 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:50,917 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 0f58ff38b5488b374d714530a4b54651: Waiting for close lock at 1676318630916Disabling compacts and flushes for region at 1676318630916Disabling writes for close at 1676318630917 (+1 ms)Writing region close event to WAL at 1676318630917Closed at 1676318630917 2023-02-13 20:03:50,917 INFO [Listener at localhost/43253] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676318629840 type: FLUSH version: 2 ttl: 0 2023-02-13 20:03:50,917 DEBUG [Listener at localhost/43253] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36729/user/jenkins/test-data/f1db69a1-eda1-07d5-e0a9-dc1959f369a0/foo/74360339-158b-4e3c-be2d-55ca862442dd 2023-02-13 20:03:50,917 DEBUG [Listener at localhost/43253] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36729/user/jenkins/test-data/f1db69a1-eda1-07d5-e0a9-dc1959f369a0/foo/74360339-158b-4e3c-be2d-55ca862442dd 2023-02-13 20:03:50,917 DEBUG [Listener at localhost/43253] util.CommonFSUtils(699): |-data/ 2023-02-13 20:03:50,918 DEBUG [Listener at localhost/43253] util.CommonFSUtils(699): |----default/ 2023-02-13 20:03:50,919 DEBUG [Listener at localhost/43253] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-13 20:03:50,919 DEBUG [Listener at localhost/43253] util.CommonFSUtils(699): |----------0f58ff38b5488b374d714530a4b54651/ 2023-02-13 20:03:50,920 DEBUG [Listener at localhost/43253] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:50,920 DEBUG [Listener at localhost/43253] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:50,920 DEBUG [Listener at localhost/43253] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=0f58ff38b5488b374d714530a4b54651-0105c64ec1ef4f80a9f1a2309ed64a16 2023-02-13 20:03:50,920 DEBUG [Listener at localhost/43253] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:50,921 DEBUG [Listener at localhost/43253] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=0f58ff38b5488b374d714530a4b54651-05dcb6adff564df39cdc99b8773b93a3 2023-02-13 20:03:50,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-13 20:03:50,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-13 20:03:50,926 INFO [Listener at localhost/43253] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:50,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 20:03:50,932 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318630932"}]},"ts":"1676318630932"} 2023-02-13 20:03:50,933 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-13 20:03:50,935 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-13 20:03:50,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=0f58ff38b5488b374d714530a4b54651, UNASSIGN}] 2023-02-13 20:03:50,938 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=0f58ff38b5488b374d714530a4b54651, UNASSIGN 2023-02-13 20:03:50,938 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0f58ff38b5488b374d714530a4b54651, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:50,938 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676318630938"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318630938"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318630938"}]},"ts":"1676318630938"} 2023-02-13 20:03:50,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 0f58ff38b5488b374d714530a4b54651, server=jenkins-hbase4.apache.org,34391,1676318627895}] 2023-02-13 20:03:51,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 20:03:51,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:51,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0f58ff38b5488b374d714530a4b54651, disabling compactions & flushes 2023-02-13 20:03:51,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:51,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:51,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. after waiting 0 ms 2023-02-13 20:03:51,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:51,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:51,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651. 2023-02-13 20:03:51,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0f58ff38b5488b374d714530a4b54651: Waiting for close lock at 1676318631092Running coprocessor pre-close hooks at 1676318631092Disabling compacts and flushes for region at 1676318631092Disabling writes for close at 1676318631093 (+1 ms)Writing region close event to WAL at 1676318631093Running coprocessor post-close hooks at 1676318631097 (+4 ms)Closed at 1676318631098 (+1 ms) 2023-02-13 20:03:51,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:51,100 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=0f58ff38b5488b374d714530a4b54651, regionState=CLOSED 2023-02-13 20:03:51,100 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676318631100"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318631100"}]},"ts":"1676318631100"} 2023-02-13 20:03:51,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 20:03:51,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 0f58ff38b5488b374d714530a4b54651, server=jenkins-hbase4.apache.org,34391,1676318627895 in 161 msec 2023-02-13 20:03:51,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 20:03:51,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=0f58ff38b5488b374d714530a4b54651, UNASSIGN in 167 msec 2023-02-13 20:03:51,104 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318631104"}]},"ts":"1676318631104"} 2023-02-13 20:03:51,105 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-13 20:03:51,107 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-13 20:03:51,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 181 msec 2023-02-13 20:03:51,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 20:03:51,235 INFO [Listener at localhost/43253] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-13 20:03:51,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:51,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:51,238 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:51,238 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:51,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 20:03:51,242 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:51,243 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f1, FileablePath, hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f2, FileablePath, hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/recovered.edits] 2023-02-13 20:03:51,247 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f1/0105c64ec1ef4f80a9f1a2309ed64a16 to hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/archive/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f1/0105c64ec1ef4f80a9f1a2309ed64a16 2023-02-13 20:03:51,248 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f1/2946031ae3024c2f88dc9253096e9a2d to hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/archive/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f1/2946031ae3024c2f88dc9253096e9a2d 2023-02-13 20:03:51,250 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f2/05dcb6adff564df39cdc99b8773b93a3 to hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/archive/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f2/05dcb6adff564df39cdc99b8773b93a3 2023-02-13 20:03:51,252 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f2/4eccee10f4174569b1b4fbc6507ec57d to hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/archive/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/f2/4eccee10f4174569b1b4fbc6507ec57d 2023-02-13 20:03:51,254 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/recovered.edits/12.seqid to hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/archive/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651/recovered.edits/12.seqid 2023-02-13 20:03:51,255 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/.tmp/data/default/testInitTableSnapshotMapperJobConfig/0f58ff38b5488b374d714530a4b54651 2023-02-13 20:03:51,255 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-13 20:03:51,257 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:51,258 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-13 20:03:51,260 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-13 20:03:51,261 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:51,261 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-13 20:03:51,261 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318631261"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:51,263 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 20:03:51,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0f58ff38b5488b374d714530a4b54651, NAME => 'testInitTableSnapshotMapperJobConfig,,1676318629040.0f58ff38b5488b374d714530a4b54651.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 20:03:51,263 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-13 20:03:51,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676318631263"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:51,266 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-13 20:03:51,270 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 20:03:51,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 34 msec 2023-02-13 20:03:51,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42265] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 20:03:51,341 INFO [Listener at localhost/43253] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-13 20:03:51,341 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 20:03:51,341 INFO [Listener at localhost/43253] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 20:03:51,341 DEBUG [Listener at localhost/43253] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65cc751a to 127.0.0.1:57579 2023-02-13 20:03:51,341 DEBUG [Listener at localhost/43253] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:51,341 DEBUG [Listener at localhost/43253] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 20:03:51,342 DEBUG [Listener at localhost/43253] util.JVMClusterUtil(257): Found active master hash=154247063, stopped=false 2023-02-13 20:03:51,342 INFO [Listener at localhost/43253] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42265,1676318627812 2023-02-13 20:03:51,343 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:51,343 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:51,343 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:51,343 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:51,343 INFO [Listener at localhost/43253] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 20:03:51,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:51,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:51,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:51,345 DEBUG [Listener at localhost/43253] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x216cd758 to 127.0.0.1:57579 2023-02-13 20:03:51,345 DEBUG [Listener at localhost/43253] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:51,345 INFO [Listener at localhost/43253] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39645,1676318627862' ***** 2023-02-13 20:03:51,346 INFO [Listener at localhost/43253] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:03:51,346 INFO [Listener at localhost/43253] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34391,1676318627895' ***** 2023-02-13 20:03:51,346 INFO [Listener at localhost/43253] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:03:51,346 INFO [RS:0;jenkins-hbase4:39645] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:03:51,346 INFO [RS:0;jenkins-hbase4:39645] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:03:51,346 INFO [RS:1;jenkins-hbase4:34391] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:03:51,346 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:03:51,346 INFO [RS:0;jenkins-hbase4:39645] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:03:51,346 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:03:51,347 INFO [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:51,346 INFO [RS:1;jenkins-hbase4:34391] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:03:51,348 DEBUG [RS:0;jenkins-hbase4:39645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c4bfeb3 to 127.0.0.1:57579 2023-02-13 20:03:51,348 INFO [RS:1;jenkins-hbase4:34391] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:03:51,348 DEBUG [RS:0;jenkins-hbase4:39645] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:51,348 INFO [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(3304): Received CLOSE for fb8e1f9a81808ff78e12b3c7f45303f7 2023-02-13 20:03:51,348 INFO [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:51,348 INFO [RS:0;jenkins-hbase4:39645] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:03:51,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fb8e1f9a81808ff78e12b3c7f45303f7, disabling compactions & flushes 2023-02-13 20:03:51,349 DEBUG [RS:1;jenkins-hbase4:34391] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65b5cf50 to 127.0.0.1:57579 2023-02-13 20:03:51,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. 2023-02-13 20:03:51,349 INFO [RS:0;jenkins-hbase4:39645] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:03:51,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. 2023-02-13 20:03:51,349 INFO [RS:0;jenkins-hbase4:39645] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:03:51,349 DEBUG [RS:1;jenkins-hbase4:34391] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:51,349 INFO [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 20:03:51,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. after waiting 0 ms 2023-02-13 20:03:51,349 INFO [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 20:03:51,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. 2023-02-13 20:03:51,350 DEBUG [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(1479): Online Regions={fb8e1f9a81808ff78e12b3c7f45303f7=hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7.} 2023-02-13 20:03:51,350 INFO [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 20:03:51,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing fb8e1f9a81808ff78e12b3c7f45303f7 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 20:03:51,350 DEBUG [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(1505): Waiting on fb8e1f9a81808ff78e12b3c7f45303f7 2023-02-13 20:03:51,350 DEBUG [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 20:03:51,350 DEBUG [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 20:03:51,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:03:51,350 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:03:51,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:03:51,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:03:51,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:03:51,351 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-13 20:03:51,367 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/.tmp/info/e02a3bbb1cb644c8aedf18e91ad697e3 2023-02-13 20:03:51,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/namespace/fb8e1f9a81808ff78e12b3c7f45303f7/.tmp/info/438c62540d2d47fe971fd2d58ed782e4 2023-02-13 20:03:51,371 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:51,376 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:51,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e02a3bbb1cb644c8aedf18e91ad697e3 2023-02-13 20:03:51,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/namespace/fb8e1f9a81808ff78e12b3c7f45303f7/.tmp/info/438c62540d2d47fe971fd2d58ed782e4 as hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/namespace/fb8e1f9a81808ff78e12b3c7f45303f7/info/438c62540d2d47fe971fd2d58ed782e4 2023-02-13 20:03:51,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/namespace/fb8e1f9a81808ff78e12b3c7f45303f7/info/438c62540d2d47fe971fd2d58ed782e4, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 20:03:51,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fb8e1f9a81808ff78e12b3c7f45303f7 in 42ms, sequenceid=6, compaction requested=false 2023-02-13 20:03:51,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/.tmp/rep_barrier/30462b01645543a4abeedfe33b3816a0 2023-02-13 20:03:51,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/namespace/fb8e1f9a81808ff78e12b3c7f45303f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 20:03:51,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. 2023-02-13 20:03:51,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fb8e1f9a81808ff78e12b3c7f45303f7: Waiting for close lock at 1676318631349Running coprocessor pre-close hooks at 1676318631349Disabling compacts and flushes for region at 1676318631349Disabling writes for close at 1676318631349Obtaining lock to block concurrent updates at 1676318631350 (+1 ms)Preparing flush snapshotting stores in fb8e1f9a81808ff78e12b3c7f45303f7 at 1676318631350Finished memstore snapshotting hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676318631350Flushing stores of hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. at 1676318631351 (+1 ms)Flushing fb8e1f9a81808ff78e12b3c7f45303f7/info: creating writer at 1676318631351Flushing fb8e1f9a81808ff78e12b3c7f45303f7/info: appending metadata at 1676318631353 (+2 ms)Flushing fb8e1f9a81808ff78e12b3c7f45303f7/info: closing flushed file at 1676318631354 (+1 ms)Flushing fb8e1f9a81808ff78e12b3c7f45303f7/info: reopening flushed file at 1676318631380 (+26 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fb8e1f9a81808ff78e12b3c7f45303f7 in 42ms, sequenceid=6, compaction requested=false at 1676318631392 (+12 ms)Writing region close event to WAL at 1676318631393 (+1 ms)Running coprocessor post-close hooks at 1676318631399 (+6 ms)Closed at 1676318631400 (+1 ms) 2023-02-13 20:03:51,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676318628478.fb8e1f9a81808ff78e12b3c7f45303f7. 2023-02-13 20:03:51,402 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 30462b01645543a4abeedfe33b3816a0 2023-02-13 20:03:51,411 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/.tmp/table/e3f9616f48d9417cb6c03768177f6d4a 2023-02-13 20:03:51,414 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e3f9616f48d9417cb6c03768177f6d4a 2023-02-13 20:03:51,415 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/.tmp/info/e02a3bbb1cb644c8aedf18e91ad697e3 as hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/info/e02a3bbb1cb644c8aedf18e91ad697e3 2023-02-13 20:03:51,420 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e02a3bbb1cb644c8aedf18e91ad697e3 2023-02-13 20:03:51,420 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/info/e02a3bbb1cb644c8aedf18e91ad697e3, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 20:03:51,421 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/.tmp/rep_barrier/30462b01645543a4abeedfe33b3816a0 as hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/rep_barrier/30462b01645543a4abeedfe33b3816a0 2023-02-13 20:03:51,424 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 30462b01645543a4abeedfe33b3816a0 2023-02-13 20:03:51,424 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/rep_barrier/30462b01645543a4abeedfe33b3816a0, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 20:03:51,425 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/.tmp/table/e3f9616f48d9417cb6c03768177f6d4a as hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/table/e3f9616f48d9417cb6c03768177f6d4a 2023-02-13 20:03:51,429 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e3f9616f48d9417cb6c03768177f6d4a 2023-02-13 20:03:51,429 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/table/e3f9616f48d9417cb6c03768177f6d4a, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 20:03:51,430 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 80ms, sequenceid=21, compaction requested=false 2023-02-13 20:03:51,434 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 20:03:51,435 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 20:03:51,436 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:03:51,436 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318631350Running coprocessor pre-close hooks at 1676318631350Disabling compacts and flushes for region at 1676318631350Disabling writes for close at 1676318631350Obtaining lock to block concurrent updates at 1676318631351 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676318631351Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676318631351Flushing stores of hbase:meta,,1.1588230740 at 1676318631351Flushing 1588230740/info: creating writer at 1676318631351Flushing 1588230740/info: appending metadata at 1676318631354 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676318631354Flushing 1588230740/rep_barrier: creating writer at 1676318631378 (+24 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676318631381 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676318631381Flushing 1588230740/table: creating writer at 1676318631402 (+21 ms)Flushing 1588230740/table: appending metadata at 1676318631404 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676318631404Flushing 1588230740/info: reopening flushed file at 1676318631416 (+12 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676318631421 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676318631426 (+5 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 80ms, sequenceid=21, compaction requested=false at 1676318631430 (+4 ms)Writing region close event to WAL at 1676318631431 (+1 ms)Running coprocessor post-close hooks at 1676318631435 (+4 ms)Closed at 1676318631436 (+1 ms) 2023-02-13 20:03:51,436 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 20:03:51,550 INFO [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34391,1676318627895; all regions closed. 2023-02-13 20:03:51,550 INFO [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39645,1676318627862; all regions closed. 2023-02-13 20:03:51,557 DEBUG [RS:1;jenkins-hbase4:34391] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/oldWALs 2023-02-13 20:03:51,557 INFO [RS:1;jenkins-hbase4:34391] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34391%2C1676318627895:(num 1676318628833) 2023-02-13 20:03:51,557 DEBUG [RS:0;jenkins-hbase4:39645] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/oldWALs 2023-02-13 20:03:51,557 DEBUG [RS:1;jenkins-hbase4:34391] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:51,557 INFO [RS:0;jenkins-hbase4:39645] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39645%2C1676318627862.meta:.meta(num 1676318628422) 2023-02-13 20:03:51,557 INFO [RS:1;jenkins-hbase4:34391] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:51,558 INFO [RS:1;jenkins-hbase4:34391] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 20:03:51,558 INFO [RS:1;jenkins-hbase4:34391] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:03:51,558 INFO [RS:1;jenkins-hbase4:34391] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:03:51,558 INFO [RS:1;jenkins-hbase4:34391] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:03:51,558 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:03:51,559 INFO [RS:1;jenkins-hbase4:34391] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34391 2023-02-13 20:03:51,561 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:51,561 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:51,561 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34391,1676318627895 2023-02-13 20:03:51,561 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:51,561 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:51,562 ERROR [Listener at localhost/43253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@55a0e2ef rejected from java.util.concurrent.ThreadPoolExecutor@519f6c83[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:51,562 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34391,1676318627895] 2023-02-13 20:03:51,562 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34391,1676318627895; numProcessing=1 2023-02-13 20:03:51,563 DEBUG [RS:0;jenkins-hbase4:39645] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/oldWALs 2023-02-13 20:03:51,563 INFO [RS:0;jenkins-hbase4:39645] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39645%2C1676318627862:(num 1676318629197) 2023-02-13 20:03:51,563 DEBUG [RS:0;jenkins-hbase4:39645] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:51,563 INFO [RS:0;jenkins-hbase4:39645] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:51,563 INFO [RS:0;jenkins-hbase4:39645] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 20:03:51,564 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:03:51,564 INFO [RS:0;jenkins-hbase4:39645] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39645 2023-02-13 20:03:51,565 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34391,1676318627895 already deleted, retry=false 2023-02-13 20:03:51,565 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34391,1676318627895 expired; onlineServers=1 2023-02-13 20:03:51,566 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:51,566 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39645,1676318627862 2023-02-13 20:03:51,566 ERROR [Listener at localhost/43253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@41ccf934 rejected from java.util.concurrent.ThreadPoolExecutor@45f365d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:51,567 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39645,1676318627862] 2023-02-13 20:03:51,567 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39645,1676318627862; numProcessing=2 2023-02-13 20:03:51,568 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39645,1676318627862 already deleted, retry=false 2023-02-13 20:03:51,568 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39645,1676318627862 expired; onlineServers=0 2023-02-13 20:03:51,568 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42265,1676318627812' ***** 2023-02-13 20:03:51,568 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 20:03:51,569 DEBUG [M:0;jenkins-hbase4:42265] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d0e0a69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:03:51,569 INFO [M:0;jenkins-hbase4:42265] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42265,1676318627812 2023-02-13 20:03:51,569 INFO [M:0;jenkins-hbase4:42265] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42265,1676318627812; all regions closed. 2023-02-13 20:03:51,569 DEBUG [M:0;jenkins-hbase4:42265] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:51,569 DEBUG [M:0;jenkins-hbase4:42265] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 20:03:51,569 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 20:03:51,569 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318628071] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318628071,5,FailOnTimeoutGroup] 2023-02-13 20:03:51,569 DEBUG [M:0;jenkins-hbase4:42265] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 20:03:51,569 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318628071] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318628071,5,FailOnTimeoutGroup] 2023-02-13 20:03:51,570 INFO [M:0;jenkins-hbase4:42265] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 20:03:51,570 INFO [M:0;jenkins-hbase4:42265] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 20:03:51,570 INFO [M:0;jenkins-hbase4:42265] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 20:03:51,570 DEBUG [M:0;jenkins-hbase4:42265] master.HMaster(1502): Stopping service threads 2023-02-13 20:03:51,570 INFO [M:0;jenkins-hbase4:42265] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 20:03:51,571 ERROR [M:0;jenkins-hbase4:42265] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 20:03:51,571 INFO [M:0;jenkins-hbase4:42265] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 20:03:51,571 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 20:03:51,571 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:51,571 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:51,572 DEBUG [M:0;jenkins-hbase4:42265] zookeeper.ZKUtil(398): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 20:03:51,572 WARN [M:0;jenkins-hbase4:42265] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 20:03:51,572 INFO [M:0;jenkins-hbase4:42265] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 20:03:51,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:51,572 INFO [M:0;jenkins-hbase4:42265] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 20:03:51,573 DEBUG [M:0;jenkins-hbase4:42265] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:03:51,573 INFO [M:0;jenkins-hbase4:42265] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:51,573 DEBUG [M:0;jenkins-hbase4:42265] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:51,573 DEBUG [M:0;jenkins-hbase4:42265] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:03:51,573 DEBUG [M:0;jenkins-hbase4:42265] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:51,573 INFO [M:0;jenkins-hbase4:42265] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.88 KB heapSize=66.81 KB 2023-02-13 20:03:51,582 INFO [M:0;jenkins-hbase4:42265] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.88 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5575bee1d2f4486bbac72076259d4e5a 2023-02-13 20:03:51,587 DEBUG [M:0;jenkins-hbase4:42265] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5575bee1d2f4486bbac72076259d4e5a as hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5575bee1d2f4486bbac72076259d4e5a 2023-02-13 20:03:51,591 INFO [M:0;jenkins-hbase4:42265] regionserver.HStore(1080): Added hdfs://localhost:36729/user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5575bee1d2f4486bbac72076259d4e5a, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 20:03:51,592 INFO [M:0;jenkins-hbase4:42265] regionserver.HRegion(2947): Finished flush of dataSize ~55.88 KB/57217, heapSize ~66.80 KB/68400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false 2023-02-13 20:03:51,592 INFO [M:0;jenkins-hbase4:42265] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:51,592 DEBUG [M:0;jenkins-hbase4:42265] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318631572Disabling compacts and flushes for region at 1676318631572Disabling writes for close at 1676318631573 (+1 ms)Obtaining lock to block concurrent updates at 1676318631573Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676318631573Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57217, getHeapSize=68400, getOffHeapSize=0, getCellsCount=145 at 1676318631573Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676318631574 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676318631574Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676318631577 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676318631577Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676318631588 (+11 ms)Finished flush of dataSize ~55.88 KB/57217, heapSize ~66.80 KB/68400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 19ms, sequenceid=132, compaction requested=false at 1676318631592 (+4 ms)Writing region close event to WAL at 1676318631592Closed at 1676318631592 2023-02-13 20:03:51,596 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/bd1d9e87-29d9-cbd2-dcd8-93254d979f7d/MasterData/WALs/jenkins-hbase4.apache.org,42265,1676318627812/jenkins-hbase4.apache.org%2C42265%2C1676318627812.1676318627985 not finished, retry = 0 2023-02-13 20:03:51,697 INFO [M:0;jenkins-hbase4:42265] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 20:03:51,697 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:03:51,698 INFO [M:0;jenkins-hbase4:42265] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42265 2023-02-13 20:03:51,699 DEBUG [M:0;jenkins-hbase4:42265] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42265,1676318627812 already deleted, retry=false 2023-02-13 20:03:51,746 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:51,746 INFO [RS:0;jenkins-hbase4:39645] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39645,1676318627862; zookeeper connection closed. 2023-02-13 20:03:51,746 ERROR [Listener at localhost/43253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1798bb92 rejected from java.util.concurrent.ThreadPoolExecutor@45f365d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:51,748 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@45135c20] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@45135c20 2023-02-13 20:03:51,748 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:39645-0x1004f4841980001, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:51,748 ERROR [Listener at localhost/43253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6fb8e333 rejected from java.util.concurrent.ThreadPoolExecutor@45f365d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:51,846 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:51,846 INFO [RS:1;jenkins-hbase4:34391] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34391,1676318627895; zookeeper connection closed. 2023-02-13 20:03:51,846 ERROR [Listener at localhost/43253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@77262d2b rejected from java.util.concurrent.ThreadPoolExecutor@519f6c83[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:51,846 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): regionserver:34391-0x1004f4841980002, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:51,846 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4e64fe02] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4e64fe02 2023-02-13 20:03:51,846 ERROR [Listener at localhost/43253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f9285f5 rejected from java.util.concurrent.ThreadPoolExecutor@519f6c83[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:51,846 INFO [Listener at localhost/43253] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 20:03:51,946 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:51,946 INFO [M:0;jenkins-hbase4:42265] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42265,1676318627812; zookeeper connection closed. 2023-02-13 20:03:51,946 ERROR [Listener at localhost/43253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a46475 rejected from java.util.concurrent.ThreadPoolExecutor@49bf0b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:51,947 DEBUG [Listener at localhost/43253-EventThread] zookeeper.ZKWatcher(600): master:42265-0x1004f4841980000, quorum=127.0.0.1:57579, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:51,947 ERROR [Listener at localhost/43253-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@53361867 rejected from java.util.concurrent.ThreadPoolExecutor@49bf0b9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:51,947 WARN [Listener at localhost/43253] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:03:51,951 INFO [Listener at localhost/43253] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:03:52,057 WARN [BP-267393048-172.31.14.131-1676318627251 heartbeating to localhost/127.0.0.1:36729] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 20:03:52,057 WARN [BP-267393048-172.31.14.131-1676318627251 heartbeating to localhost/127.0.0.1:36729] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-267393048-172.31.14.131-1676318627251 (Datanode Uuid 6d661a83-0c46-4410-95fc-d60e3b3fdf9a) service to localhost/127.0.0.1:36729 2023-02-13 20:03:52,058 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/cluster_8bd56495-3168-3dcd-8bdf-b53fee21a826/dfs/data/data3/current/BP-267393048-172.31.14.131-1676318627251] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:03:52,058 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/cluster_8bd56495-3168-3dcd-8bdf-b53fee21a826/dfs/data/data4/current/BP-267393048-172.31.14.131-1676318627251] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:03:52,060 WARN [Listener at localhost/43253] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:03:52,062 INFO [Listener at localhost/43253] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:03:52,168 WARN [BP-267393048-172.31.14.131-1676318627251 heartbeating to localhost/127.0.0.1:36729] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 20:03:52,168 WARN [BP-267393048-172.31.14.131-1676318627251 heartbeating to localhost/127.0.0.1:36729] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-267393048-172.31.14.131-1676318627251 (Datanode Uuid fdf4ac65-1b4b-4319-9c52-16a9c3164a13) service to localhost/127.0.0.1:36729 2023-02-13 20:03:52,168 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/cluster_8bd56495-3168-3dcd-8bdf-b53fee21a826/dfs/data/data1/current/BP-267393048-172.31.14.131-1676318627251] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:03:52,169 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/cluster_8bd56495-3168-3dcd-8bdf-b53fee21a826/dfs/data/data2/current/BP-267393048-172.31.14.131-1676318627251] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:03:52,179 INFO [Listener at localhost/43253] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:03:52,294 INFO [Listener at localhost/43253] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 20:03:52,317 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 20:03:52,330 INFO [Listener at localhost/43253] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=178 (was 153) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:36729 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:36729 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/43253 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42265,1676318627812)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36729 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:36729 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:36729 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:36729 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:36729 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=567 (was 534) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=262 (was 276), ProcessCount=166 (was 166), AvailableMemoryMB=1645 (was 1700) 2023-02-13 20:03:52,345 INFO [Listener at localhost/43253] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=178, OpenFileDescriptor=567, MaxFileDescriptor=60000, SystemLoadAverage=262, ProcessCount=166, AvailableMemoryMB=1645 2023-02-13 20:03:52,360 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/hadoop.log.dir so I do NOT create it in target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1 2023-02-13 20:03:52,360 WARN [Listener at localhost/43253] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 20:03:52,360 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/hadoop.tmp.dir so I do NOT create it in target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1 2023-02-13 20:03:52,360 WARN [Listener at localhost/43253] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4ec6bfb0-fdae-616b-d1bd-0a4b13e2b01e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 20:03:52,360 DEBUG [Listener at localhost/43253] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1 2023-02-13 20:03:52,361 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 20:03:52,361 INFO [Listener at localhost/43253] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/cluster_b33b9088-86d3-ec37-fffd-219cb83507c7, deleteOnExit=true 2023-02-13 20:03:52,361 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 20:03:52,362 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/test.cache.data in system properties and HBase conf 2023-02-13 20:03:52,362 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 20:03:52,362 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/hadoop.log.dir in system properties and HBase conf 2023-02-13 20:03:52,362 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 20:03:52,362 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 20:03:52,362 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 20:03:52,362 DEBUG [Listener at localhost/43253] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 20:03:52,363 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:03:52,363 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:03:52,363 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 20:03:52,363 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:03:52,363 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 20:03:52,364 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 20:03:52,364 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:03:52,364 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:03:52,364 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 20:03:52,364 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/nfs.dump.dir in system properties and HBase conf 2023-02-13 20:03:52,364 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/java.io.tmpdir in system properties and HBase conf 2023-02-13 20:03:52,364 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:03:52,364 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 20:03:52,365 INFO [Listener at localhost/43253] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 20:03:52,369 WARN [Listener at localhost/43253] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:03:52,370 WARN [Listener at localhost/43253] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:03:52,445 WARN [Listener at localhost/43253] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:03:52,447 INFO [Listener at localhost/43253] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:03:52,452 INFO [Listener at localhost/43253] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/java.io.tmpdir/Jetty_localhost_43863_hdfs____.bu8d34/webapp 2023-02-13 20:03:52,545 INFO [Listener at localhost/43253] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43863 2023-02-13 20:03:52,549 WARN [Listener at localhost/43253] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:03:52,549 WARN [Listener at localhost/43253] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:03:52,592 WARN [Listener at localhost/36121] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:03:52,607 WARN [Listener at localhost/36121] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:03:52,609 WARN [Listener at localhost/36121] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:03:52,610 INFO [Listener at localhost/36121] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:03:52,615 INFO [Listener at localhost/36121] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/java.io.tmpdir/Jetty_localhost_35439_datanode____.khexb5/webapp 2023-02-13 20:03:52,706 INFO [Listener at localhost/36121] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35439 2023-02-13 20:03:52,714 WARN [Listener at localhost/44079] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:03:52,731 WARN [Listener at localhost/44079] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:03:52,734 WARN [Listener at localhost/44079] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:03:52,735 INFO [Listener at localhost/44079] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:03:52,740 INFO [Listener at localhost/44079] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/java.io.tmpdir/Jetty_localhost_45287_datanode____.91ayyx/webapp 2023-02-13 20:03:52,820 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xff425098d74f171a: Processing first storage report for DS-38d83e0c-9884-4aff-bb17-780d05719599 from datanode cc3e1ef8-df74-4bba-8b57-932753adb0ea 2023-02-13 20:03:52,820 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xff425098d74f171a: from storage DS-38d83e0c-9884-4aff-bb17-780d05719599 node DatanodeRegistration(127.0.0.1:35133, datanodeUuid=cc3e1ef8-df74-4bba-8b57-932753adb0ea, infoPort=33753, infoSecurePort=0, ipcPort=44079, storageInfo=lv=-57;cid=testClusterID;nsid=172154225;c=1676318632372), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:52,820 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xff425098d74f171a: Processing first storage report for DS-73dd5291-26ec-4df0-8372-876a23ac0006 from datanode cc3e1ef8-df74-4bba-8b57-932753adb0ea 2023-02-13 20:03:52,820 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xff425098d74f171a: from storage DS-73dd5291-26ec-4df0-8372-876a23ac0006 node DatanodeRegistration(127.0.0.1:35133, datanodeUuid=cc3e1ef8-df74-4bba-8b57-932753adb0ea, infoPort=33753, infoSecurePort=0, ipcPort=44079, storageInfo=lv=-57;cid=testClusterID;nsid=172154225;c=1676318632372), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:52,849 INFO [Listener at localhost/44079] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45287 2023-02-13 20:03:52,859 WARN [Listener at localhost/37999] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:03:52,952 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4038654aa4e9e1ac: Processing first storage report for DS-9bcd6318-64e2-4b95-b6f1-b26a4ddfa232 from datanode 5a9f0f80-a2cf-454c-954e-14a9d831c616 2023-02-13 20:03:52,952 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4038654aa4e9e1ac: from storage DS-9bcd6318-64e2-4b95-b6f1-b26a4ddfa232 node DatanodeRegistration(127.0.0.1:34561, datanodeUuid=5a9f0f80-a2cf-454c-954e-14a9d831c616, infoPort=45949, infoSecurePort=0, ipcPort=37999, storageInfo=lv=-57;cid=testClusterID;nsid=172154225;c=1676318632372), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:52,952 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4038654aa4e9e1ac: Processing first storage report for DS-e3a92d5f-c202-4e8a-a9d6-ff6a4b56ec1b from datanode 5a9f0f80-a2cf-454c-954e-14a9d831c616 2023-02-13 20:03:52,953 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4038654aa4e9e1ac: from storage DS-e3a92d5f-c202-4e8a-a9d6-ff6a4b56ec1b node DatanodeRegistration(127.0.0.1:34561, datanodeUuid=5a9f0f80-a2cf-454c-954e-14a9d831c616, infoPort=45949, infoSecurePort=0, ipcPort=37999, storageInfo=lv=-57;cid=testClusterID;nsid=172154225;c=1676318632372), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:03:52,971 DEBUG [Listener at localhost/37999] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1 2023-02-13 20:03:52,973 INFO [Listener at localhost/37999] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/cluster_b33b9088-86d3-ec37-fffd-219cb83507c7/zookeeper_0, clientPort=56374, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/cluster_b33b9088-86d3-ec37-fffd-219cb83507c7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/cluster_b33b9088-86d3-ec37-fffd-219cb83507c7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 20:03:52,974 INFO [Listener at localhost/37999] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56374 2023-02-13 20:03:52,975 INFO [Listener at localhost/37999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:52,975 INFO [Listener at localhost/37999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:52,993 INFO [Listener at localhost/37999] util.FSUtils(479): Created version file at hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de with version=8 2023-02-13 20:03:52,994 INFO [Listener at localhost/37999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:52,995 INFO [Listener at localhost/37999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:52,996 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/hbase-staging 2023-02-13 20:03:52,997 INFO [Listener at localhost/37999] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:03:52,997 INFO [Listener at localhost/37999] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:52,998 INFO [Listener at localhost/37999] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:52,998 INFO [Listener at localhost/37999] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:03:52,998 INFO [Listener at localhost/37999] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:52,998 INFO [Listener at localhost/37999] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:03:52,998 INFO [Listener at localhost/37999] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:03:52,999 INFO [Listener at localhost/37999] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43055 2023-02-13 20:03:52,999 INFO [Listener at localhost/37999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:53,000 INFO [Listener at localhost/37999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:53,000 INFO [Listener at localhost/37999] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43055 connecting to ZooKeeper ensemble=127.0.0.1:56374 2023-02-13 20:03:53,008 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:430550x0, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:03:53,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:43055-0x1004f4855d20000 connected 2023-02-13 20:03:53,026 DEBUG [Listener at localhost/37999] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:53,026 DEBUG [Listener at localhost/37999] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:53,027 DEBUG [Listener at localhost/37999] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:03:53,028 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43055 2023-02-13 20:03:53,028 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43055 2023-02-13 20:03:53,028 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43055 2023-02-13 20:03:53,029 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43055 2023-02-13 20:03:53,032 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43055 2023-02-13 20:03:53,032 INFO [Listener at localhost/37999] master.HMaster(439): hbase.rootdir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de, hbase.cluster.distributed=false 2023-02-13 20:03:53,044 INFO [Listener at localhost/37999] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:03:53,044 INFO [Listener at localhost/37999] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:53,044 INFO [Listener at localhost/37999] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:53,045 INFO [Listener at localhost/37999] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:03:53,045 INFO [Listener at localhost/37999] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:53,045 INFO [Listener at localhost/37999] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:03:53,045 INFO [Listener at localhost/37999] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:03:53,045 INFO [Listener at localhost/37999] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35759 2023-02-13 20:03:53,046 INFO [Listener at localhost/37999] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:03:53,047 DEBUG [Listener at localhost/37999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:53,048 INFO [Listener at localhost/37999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:53,049 INFO [Listener at localhost/37999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:53,050 INFO [Listener at localhost/37999] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35759 connecting to ZooKeeper ensemble=127.0.0.1:56374 2023-02-13 20:03:53,054 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:357590x0, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:03:53,056 DEBUG [Listener at localhost/37999] zookeeper.ZKUtil(164): regionserver:357590x0, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:53,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35759-0x1004f4855d20001 connected 2023-02-13 20:03:53,057 DEBUG [Listener at localhost/37999] zookeeper.ZKUtil(164): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:53,057 DEBUG [Listener at localhost/37999] zookeeper.ZKUtil(164): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:03:53,059 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35759 2023-02-13 20:03:53,059 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35759 2023-02-13 20:03:53,060 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35759 2023-02-13 20:03:53,061 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35759 2023-02-13 20:03:53,062 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35759 2023-02-13 20:03:53,073 INFO [Listener at localhost/37999] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:03:53,073 INFO [Listener at localhost/37999] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:53,073 INFO [Listener at localhost/37999] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:53,073 INFO [Listener at localhost/37999] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:03:53,073 INFO [Listener at localhost/37999] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:03:53,073 INFO [Listener at localhost/37999] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:03:53,073 INFO [Listener at localhost/37999] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:03:53,075 INFO [Listener at localhost/37999] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35987 2023-02-13 20:03:53,076 INFO [Listener at localhost/37999] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:03:53,077 DEBUG [Listener at localhost/37999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:53,077 INFO [Listener at localhost/37999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:53,078 INFO [Listener at localhost/37999] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:53,079 INFO [Listener at localhost/37999] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35987 connecting to ZooKeeper ensemble=127.0.0.1:56374 2023-02-13 20:03:53,082 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:359870x0, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:03:53,083 DEBUG [Listener at localhost/37999] zookeeper.ZKUtil(164): regionserver:359870x0, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:53,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35987-0x1004f4855d20002 connected 2023-02-13 20:03:53,084 DEBUG [Listener at localhost/37999] zookeeper.ZKUtil(164): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:53,085 DEBUG [Listener at localhost/37999] zookeeper.ZKUtil(164): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:03:53,085 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35987 2023-02-13 20:03:53,088 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35987 2023-02-13 20:03:53,088 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35987 2023-02-13 20:03:53,088 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35987 2023-02-13 20:03:53,089 DEBUG [Listener at localhost/37999] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35987 2023-02-13 20:03:53,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43055,1676318632997 2023-02-13 20:03:53,091 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:03:53,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43055,1676318632997 2023-02-13 20:03:53,095 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:53,095 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:53,095 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:53,096 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:53,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:03:53,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43055,1676318632997 from backup master directory 2023-02-13 20:03:53,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:03:53,099 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43055,1676318632997 2023-02-13 20:03:53,099 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:03:53,099 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:03:53,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,43055,1676318632997 2023-02-13 20:03:53,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/hbase.id with ID: f95bc4e1-1464-4ed6-8aef-3c4a1e280ca9 2023-02-13 20:03:53,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:03:53,125 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:53,134 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0f4b58e4 to 127.0.0.1:56374 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:53,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a9d8068, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:53,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:53,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 20:03:53,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:53,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/MasterData/data/master/store-tmp 2023-02-13 20:03:53,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:53,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:03:53,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:53,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:53,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:03:53,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:53,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:53,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318633151Disabling compacts and flushes for region at 1676318633151Disabling writes for close at 1676318633151Writing region close event to WAL at 1676318633151Closed at 1676318633151 2023-02-13 20:03:53,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/MasterData/WALs/jenkins-hbase4.apache.org,43055,1676318632997 2023-02-13 20:03:53,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43055%2C1676318632997, suffix=, logDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/MasterData/WALs/jenkins-hbase4.apache.org,43055,1676318632997, archiveDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/MasterData/oldWALs, maxLogs=10 2023-02-13 20:03:53,174 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35133,DS-38d83e0c-9884-4aff-bb17-780d05719599,DISK] 2023-02-13 20:03:53,175 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34561,DS-9bcd6318-64e2-4b95-b6f1-b26a4ddfa232,DISK] 2023-02-13 20:03:53,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/MasterData/WALs/jenkins-hbase4.apache.org,43055,1676318632997/jenkins-hbase4.apache.org%2C43055%2C1676318632997.1676318633154 2023-02-13 20:03:53,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35133,DS-38d83e0c-9884-4aff-bb17-780d05719599,DISK], DatanodeInfoWithStorage[127.0.0.1:34561,DS-9bcd6318-64e2-4b95-b6f1-b26a4ddfa232,DISK]] 2023-02-13 20:03:53,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:03:53,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:53,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:53,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:53,179 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:53,181 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 20:03:53,181 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 20:03:53,182 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:53,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:53,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:53,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:03:53,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:53,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63093195, jitterRate=-0.059838131070137024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:03:53,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676318633178Initializing all the Stores at 1676318633179 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318633179Cleaning up temporary data from old regions at 1676318633183 (+4 ms)Cleaning up detritus from prior splits at 1676318633183Region opened successfully at 1676318633187 (+4 ms) 2023-02-13 20:03:53,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 20:03:53,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 20:03:53,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 20:03:53,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 20:03:53,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 20:03:53,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 20:03:53,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 20:03:53,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 20:03:53,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 20:03:53,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 20:03:53,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 20:03:53,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 20:03:53,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 20:03:53,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 20:03:53,211 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:53,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 20:03:53,212 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 20:03:53,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 20:03:53,214 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:53,214 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:53,214 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:53,214 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:53,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,43055,1676318632997, sessionid=0x1004f4855d20000, setting cluster-up flag (Was=false) 2023-02-13 20:03:53,219 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:53,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 20:03:53,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43055,1676318632997 2023-02-13 20:03:53,228 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:53,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 20:03:53,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43055,1676318632997 2023-02-13 20:03:53,233 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.hbase-snapshot/.tmp 2023-02-13 20:03:53,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 20:03:53,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:53,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:53,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:53,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:03:53,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 20:03:53,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:03:53,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676318663241 2023-02-13 20:03:53,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 20:03:53,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 20:03:53,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 20:03:53,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 20:03:53,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 20:03:53,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 20:03:53,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,241 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:03:53,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 20:03:53,242 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 20:03:53,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 20:03:53,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 20:03:53,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 20:03:53,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 20:03:53,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318633243,5,FailOnTimeoutGroup] 2023-02-13 20:03:53,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318633243,5,FailOnTimeoutGroup] 2023-02-13 20:03:53,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 20:03:53,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,243 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:53,257 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:53,257 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:53,257 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de 2023-02-13 20:03:53,267 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:53,268 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:03:53,269 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/info 2023-02-13 20:03:53,270 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:03:53,270 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:53,270 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:03:53,271 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:03:53,272 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:03:53,272 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:53,272 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:03:53,273 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/table 2023-02-13 20:03:53,274 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:03:53,274 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:53,274 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740 2023-02-13 20:03:53,275 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740 2023-02-13 20:03:53,277 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:03:53,278 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:03:53,280 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:53,280 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64048238, jitterRate=-0.04560688138008118}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:03:53,280 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676318633267Initializing all the Stores at 1676318633267Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318633267Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318633268 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318633268Cleaning up temporary data from old regions at 1676318633276 (+8 ms)Cleaning up detritus from prior splits at 1676318633276Region opened successfully at 1676318633280 (+4 ms) 2023-02-13 20:03:53,280 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:03:53,280 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:03:53,280 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:03:53,280 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:03:53,280 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:03:53,281 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:03:53,281 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318633280Disabling compacts and flushes for region at 1676318633280Disabling writes for close at 1676318633280Writing region close event to WAL at 1676318633281 (+1 ms)Closed at 1676318633281 2023-02-13 20:03:53,281 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:03:53,281 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 20:03:53,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 20:03:53,283 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 20:03:53,285 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 20:03:53,291 INFO [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(952): ClusterId : f95bc4e1-1464-4ed6-8aef-3c4a1e280ca9 2023-02-13 20:03:53,291 INFO [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(952): ClusterId : f95bc4e1-1464-4ed6-8aef-3c4a1e280ca9 2023-02-13 20:03:53,291 DEBUG [RS:1;jenkins-hbase4:35987] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:03:53,291 DEBUG [RS:0;jenkins-hbase4:35759] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:03:53,297 DEBUG [RS:1;jenkins-hbase4:35987] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:03:53,297 DEBUG [RS:0;jenkins-hbase4:35759] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:03:53,297 DEBUG [RS:1;jenkins-hbase4:35987] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:03:53,298 DEBUG [RS:0;jenkins-hbase4:35759] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:03:53,299 DEBUG [RS:1;jenkins-hbase4:35987] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:03:53,300 DEBUG [RS:0;jenkins-hbase4:35759] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:03:53,302 DEBUG [RS:0;jenkins-hbase4:35759] zookeeper.ReadOnlyZKClient(139): Connect 0x2c9cd129 to 127.0.0.1:56374 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:53,302 DEBUG [RS:1;jenkins-hbase4:35987] zookeeper.ReadOnlyZKClient(139): Connect 0x18957a2c to 127.0.0.1:56374 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:53,312 DEBUG [RS:1;jenkins-hbase4:35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1caaede6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:53,312 DEBUG [RS:0;jenkins-hbase4:35759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28a35062, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:53,312 DEBUG [RS:1;jenkins-hbase4:35987] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59a87017, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:03:53,312 DEBUG [RS:0;jenkins-hbase4:35759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6da1db12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:03:53,322 DEBUG [RS:1;jenkins-hbase4:35987] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35987 2023-02-13 20:03:53,322 INFO [RS:1;jenkins-hbase4:35987] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:03:53,323 INFO [RS:1;jenkins-hbase4:35987] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:03:53,323 DEBUG [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:03:53,323 INFO [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43055,1676318632997 with isa=jenkins-hbase4.apache.org/172.31.14.131:35987, startcode=1676318633072 2023-02-13 20:03:53,323 DEBUG [RS:1;jenkins-hbase4:35987] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:03:53,325 DEBUG [RS:0;jenkins-hbase4:35759] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35759 2023-02-13 20:03:53,325 INFO [RS:0;jenkins-hbase4:35759] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:03:53,325 INFO [RS:0;jenkins-hbase4:35759] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:03:53,325 DEBUG [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:03:53,325 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38817, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:03:53,325 INFO [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,43055,1676318632997 with isa=jenkins-hbase4.apache.org/172.31.14.131:35759, startcode=1676318633044 2023-02-13 20:03:53,326 DEBUG [RS:0;jenkins-hbase4:35759] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:03:53,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:53,328 DEBUG [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de 2023-02-13 20:03:53,328 DEBUG [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36121 2023-02-13 20:03:53,328 DEBUG [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:03:53,329 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34559, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:03:53,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:53,329 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:53,330 DEBUG [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de 2023-02-13 20:03:53,330 DEBUG [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36121 2023-02-13 20:03:53,330 DEBUG [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:03:53,330 DEBUG [RS:1;jenkins-hbase4:35987] zookeeper.ZKUtil(162): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:53,330 WARN [RS:1;jenkins-hbase4:35987] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:03:53,330 INFO [RS:1;jenkins-hbase4:35987] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:53,330 DEBUG [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/WALs/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:53,335 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35759,1676318633044] 2023-02-13 20:03:53,335 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35987,1676318633072] 2023-02-13 20:03:53,335 DEBUG [RS:0;jenkins-hbase4:35759] zookeeper.ZKUtil(162): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:53,335 WARN [RS:0;jenkins-hbase4:35759] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:03:53,335 INFO [RS:0;jenkins-hbase4:35759] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:53,335 DEBUG [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/WALs/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:53,335 DEBUG [RS:1;jenkins-hbase4:35987] zookeeper.ZKUtil(162): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:53,336 DEBUG [RS:1;jenkins-hbase4:35987] zookeeper.ZKUtil(162): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:53,337 DEBUG [RS:1;jenkins-hbase4:35987] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:03:53,337 INFO [RS:1;jenkins-hbase4:35987] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:03:53,341 INFO [RS:1;jenkins-hbase4:35987] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:03:53,342 INFO [RS:1;jenkins-hbase4:35987] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:03:53,342 INFO [RS:1;jenkins-hbase4:35987] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,342 INFO [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:03:53,344 INFO [RS:1;jenkins-hbase4:35987] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,345 DEBUG [RS:1;jenkins-hbase4:35987] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,345 DEBUG [RS:1;jenkins-hbase4:35987] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,345 DEBUG [RS:0;jenkins-hbase4:35759] zookeeper.ZKUtil(162): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:53,345 DEBUG [RS:1;jenkins-hbase4:35987] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,345 DEBUG [RS:1;jenkins-hbase4:35987] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,345 DEBUG [RS:1;jenkins-hbase4:35987] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,345 DEBUG [RS:1;jenkins-hbase4:35987] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:03:53,345 DEBUG [RS:0;jenkins-hbase4:35759] zookeeper.ZKUtil(162): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:53,345 DEBUG [RS:1;jenkins-hbase4:35987] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,345 DEBUG [RS:1;jenkins-hbase4:35987] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,345 DEBUG [RS:1;jenkins-hbase4:35987] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,345 DEBUG [RS:1;jenkins-hbase4:35987] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,346 DEBUG [RS:0;jenkins-hbase4:35759] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:03:53,346 INFO [RS:0;jenkins-hbase4:35759] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:03:53,351 INFO [RS:1;jenkins-hbase4:35987] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,351 INFO [RS:0;jenkins-hbase4:35759] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:03:53,351 INFO [RS:1;jenkins-hbase4:35987] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,352 INFO [RS:1;jenkins-hbase4:35987] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,352 INFO [RS:0;jenkins-hbase4:35759] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:03:53,352 INFO [RS:0;jenkins-hbase4:35759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,356 INFO [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:03:53,357 INFO [RS:0;jenkins-hbase4:35759] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,358 DEBUG [RS:0;jenkins-hbase4:35759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,358 DEBUG [RS:0;jenkins-hbase4:35759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,358 DEBUG [RS:0;jenkins-hbase4:35759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,358 DEBUG [RS:0;jenkins-hbase4:35759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,358 DEBUG [RS:0;jenkins-hbase4:35759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,358 DEBUG [RS:0;jenkins-hbase4:35759] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:03:53,358 DEBUG [RS:0;jenkins-hbase4:35759] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,359 DEBUG [RS:0;jenkins-hbase4:35759] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,359 DEBUG [RS:0;jenkins-hbase4:35759] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,359 DEBUG [RS:0;jenkins-hbase4:35759] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:03:53,362 INFO [RS:0;jenkins-hbase4:35759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,362 INFO [RS:0;jenkins-hbase4:35759] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,362 INFO [RS:0;jenkins-hbase4:35759] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,368 INFO [RS:1;jenkins-hbase4:35987] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:03:53,368 INFO [RS:1;jenkins-hbase4:35987] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35987,1676318633072-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,375 INFO [RS:0;jenkins-hbase4:35759] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:03:53,376 INFO [RS:0;jenkins-hbase4:35759] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35759,1676318633044-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,388 INFO [RS:1;jenkins-hbase4:35987] regionserver.Replication(203): jenkins-hbase4.apache.org,35987,1676318633072 started 2023-02-13 20:03:53,388 INFO [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35987,1676318633072, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35987, sessionid=0x1004f4855d20002 2023-02-13 20:03:53,388 DEBUG [RS:1;jenkins-hbase4:35987] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:03:53,388 DEBUG [RS:1;jenkins-hbase4:35987] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:53,388 DEBUG [RS:1;jenkins-hbase4:35987] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35987,1676318633072' 2023-02-13 20:03:53,388 DEBUG [RS:1;jenkins-hbase4:35987] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:53,389 DEBUG [RS:1;jenkins-hbase4:35987] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:53,389 DEBUG [RS:1;jenkins-hbase4:35987] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:03:53,389 DEBUG [RS:1;jenkins-hbase4:35987] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:03:53,389 DEBUG [RS:1;jenkins-hbase4:35987] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:53,389 DEBUG [RS:1;jenkins-hbase4:35987] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35987,1676318633072' 2023-02-13 20:03:53,389 DEBUG [RS:1;jenkins-hbase4:35987] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:53,390 DEBUG [RS:1;jenkins-hbase4:35987] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:53,390 DEBUG [RS:1;jenkins-hbase4:35987] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:03:53,390 INFO [RS:1;jenkins-hbase4:35987] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:03:53,390 INFO [RS:1;jenkins-hbase4:35987] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:03:53,391 INFO [RS:0;jenkins-hbase4:35759] regionserver.Replication(203): jenkins-hbase4.apache.org,35759,1676318633044 started 2023-02-13 20:03:53,391 INFO [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35759,1676318633044, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35759, sessionid=0x1004f4855d20001 2023-02-13 20:03:53,391 DEBUG [RS:0;jenkins-hbase4:35759] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:03:53,392 DEBUG [RS:0;jenkins-hbase4:35759] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:53,392 DEBUG [RS:0;jenkins-hbase4:35759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35759,1676318633044' 2023-02-13 20:03:53,392 DEBUG [RS:0;jenkins-hbase4:35759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:53,392 DEBUG [RS:0;jenkins-hbase4:35759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:53,392 DEBUG [RS:0;jenkins-hbase4:35759] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:03:53,392 DEBUG [RS:0;jenkins-hbase4:35759] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:03:53,392 DEBUG [RS:0;jenkins-hbase4:35759] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:53,392 DEBUG [RS:0;jenkins-hbase4:35759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35759,1676318633044' 2023-02-13 20:03:53,392 DEBUG [RS:0;jenkins-hbase4:35759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:53,393 DEBUG [RS:0;jenkins-hbase4:35759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:53,393 DEBUG [RS:0;jenkins-hbase4:35759] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:03:53,393 INFO [RS:0;jenkins-hbase4:35759] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:03:53,393 INFO [RS:0;jenkins-hbase4:35759] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:03:53,435 DEBUG [jenkins-hbase4:43055] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 20:03:53,435 DEBUG [jenkins-hbase4:43055] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:03:53,437 DEBUG [jenkins-hbase4:43055] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:03:53,437 DEBUG [jenkins-hbase4:43055] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:03:53,437 DEBUG [jenkins-hbase4:43055] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:03:53,438 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35987,1676318633072, state=OPENING 2023-02-13 20:03:53,440 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 20:03:53,441 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:53,441 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:03:53,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35987,1676318633072}] 2023-02-13 20:03:53,596 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:53,596 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 20:03:53,598 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 20:03:53,602 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 20:03:53,602 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:03:53,604 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35987%2C1676318633072.meta, suffix=.meta, logDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/WALs/jenkins-hbase4.apache.org,35987,1676318633072, archiveDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/oldWALs, maxLogs=32 2023-02-13 20:03:53,611 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 20:03:53,620 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35133,DS-38d83e0c-9884-4aff-bb17-780d05719599,DISK] 2023-02-13 20:03:53,620 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34561,DS-9bcd6318-64e2-4b95-b6f1-b26a4ddfa232,DISK] 2023-02-13 20:03:53,621 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/WALs/jenkins-hbase4.apache.org,35987,1676318633072/jenkins-hbase4.apache.org%2C35987%2C1676318633072.meta.1676318633604.meta 2023-02-13 20:03:53,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35133,DS-38d83e0c-9884-4aff-bb17-780d05719599,DISK], DatanodeInfoWithStorage[127.0.0.1:34561,DS-9bcd6318-64e2-4b95-b6f1-b26a4ddfa232,DISK]] 2023-02-13 20:03:53,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:03:53,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 20:03:53,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 20:03:53,622 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 20:03:53,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 20:03:53,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:53,623 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 20:03:53,623 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 20:03:53,624 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:03:53,625 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/info 2023-02-13 20:03:53,625 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/info 2023-02-13 20:03:53,625 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:03:53,626 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:53,626 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:03:53,626 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:03:53,626 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:03:53,627 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:03:53,627 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:53,627 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:03:53,628 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/table 2023-02-13 20:03:53,628 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/table 2023-02-13 20:03:53,628 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:03:53,628 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:53,629 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740 2023-02-13 20:03:53,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740 2023-02-13 20:03:53,632 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:03:53,634 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:03:53,635 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67626952, jitterRate=0.0077201128005981445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:03:53,635 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676318633623Writing region info on filesystem at 1676318633623Initializing all the Stores at 1676318633624 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318633624Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318633624Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318633624Cleaning up temporary data from old regions at 1676318633631 (+7 ms)Cleaning up detritus from prior splits at 1676318633631Running coprocessor post-open hooks at 1676318633635 (+4 ms)Region opened successfully at 1676318633635 2023-02-13 20:03:53,635 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676318633596 2023-02-13 20:03:53,640 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 20:03:53,641 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 20:03:53,641 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35987,1676318633072, state=OPEN 2023-02-13 20:03:53,644 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 20:03:53,644 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:03:53,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 20:03:53,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35987,1676318633072 in 203 msec 2023-02-13 20:03:53,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 20:03:53,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 363 msec 2023-02-13 20:03:53,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 414 msec 2023-02-13 20:03:53,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676318633092, completionTime=-1 2023-02-13 20:03:53,648 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 20:03:53,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 20:03:53,651 DEBUG [hconnection-0x7f6f4449-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:53,653 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40000, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:53,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 20:03:53,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676318693654 2023-02-13 20:03:53,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676318753654 2023-02-13 20:03:53,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-13 20:03:53,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43055,1676318632997-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43055,1676318632997-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43055,1676318632997-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43055, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 20:03:53,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 20:03:53,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:53,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 20:03:53,662 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 20:03:53,662 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:03:53,663 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:03:53,664 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/hbase/namespace/fdb64b82c98eff555990616b21e4909e 2023-02-13 20:03:53,665 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/hbase/namespace/fdb64b82c98eff555990616b21e4909e empty. 2023-02-13 20:03:53,665 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/hbase/namespace/fdb64b82c98eff555990616b21e4909e 2023-02-13 20:03:53,665 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 20:03:53,680 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:53,682 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => fdb64b82c98eff555990616b21e4909e, NAME => 'hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp 2023-02-13 20:03:53,694 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:53,694 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing fdb64b82c98eff555990616b21e4909e, disabling compactions & flushes 2023-02-13 20:03:53,694 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. 2023-02-13 20:03:53,694 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. 2023-02-13 20:03:53,695 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. after waiting 0 ms 2023-02-13 20:03:53,695 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. 2023-02-13 20:03:53,695 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. 2023-02-13 20:03:53,695 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for fdb64b82c98eff555990616b21e4909e: Waiting for close lock at 1676318633694Disabling compacts and flushes for region at 1676318633694Disabling writes for close at 1676318633695 (+1 ms)Writing region close event to WAL at 1676318633695Closed at 1676318633695 2023-02-13 20:03:53,697 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:03:53,698 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318633698"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318633698"}]},"ts":"1676318633698"} 2023-02-13 20:03:53,701 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 20:03:53,702 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:03:53,702 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318633702"}]},"ts":"1676318633702"} 2023-02-13 20:03:53,703 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 20:03:53,707 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:03:53,707 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:03:53,708 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:03:53,708 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:03:53,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fdb64b82c98eff555990616b21e4909e, ASSIGN}] 2023-02-13 20:03:53,715 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fdb64b82c98eff555990616b21e4909e, ASSIGN 2023-02-13 20:03:53,716 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=fdb64b82c98eff555990616b21e4909e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35759,1676318633044; forceNewPlan=false, retain=false 2023-02-13 20:03:53,866 INFO [jenkins-hbase4:43055] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 20:03:53,868 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fdb64b82c98eff555990616b21e4909e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:53,868 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318633868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318633868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318633868"}]},"ts":"1676318633868"} 2023-02-13 20:03:53,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure fdb64b82c98eff555990616b21e4909e, server=jenkins-hbase4.apache.org,35759,1676318633044}] 2023-02-13 20:03:54,023 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:54,023 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 20:03:54,025 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44928, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 20:03:54,029 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. 2023-02-13 20:03:54,030 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35759%2C1676318633044, suffix=, logDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/WALs/jenkins-hbase4.apache.org,35759,1676318633044, archiveDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/oldWALs, maxLogs=32 2023-02-13 20:03:54,044 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35133,DS-38d83e0c-9884-4aff-bb17-780d05719599,DISK] 2023-02-13 20:03:54,044 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34561,DS-9bcd6318-64e2-4b95-b6f1-b26a4ddfa232,DISK] 2023-02-13 20:03:54,046 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/WALs/jenkins-hbase4.apache.org,35759,1676318633044/jenkins-hbase4.apache.org%2C35759%2C1676318633044.1676318634030 2023-02-13 20:03:54,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35133,DS-38d83e0c-9884-4aff-bb17-780d05719599,DISK], DatanodeInfoWithStorage[127.0.0.1:34561,DS-9bcd6318-64e2-4b95-b6f1-b26a4ddfa232,DISK]] 2023-02-13 20:03:54,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fdb64b82c98eff555990616b21e4909e, NAME => 'hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:03:54,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace fdb64b82c98eff555990616b21e4909e 2023-02-13 20:03:54,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for fdb64b82c98eff555990616b21e4909e 2023-02-13 20:03:54,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for fdb64b82c98eff555990616b21e4909e 2023-02-13 20:03:54,048 INFO [StoreOpener-fdb64b82c98eff555990616b21e4909e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region fdb64b82c98eff555990616b21e4909e 2023-02-13 20:03:54,049 DEBUG [StoreOpener-fdb64b82c98eff555990616b21e4909e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/namespace/fdb64b82c98eff555990616b21e4909e/info 2023-02-13 20:03:54,050 DEBUG [StoreOpener-fdb64b82c98eff555990616b21e4909e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/namespace/fdb64b82c98eff555990616b21e4909e/info 2023-02-13 20:03:54,050 INFO [StoreOpener-fdb64b82c98eff555990616b21e4909e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdb64b82c98eff555990616b21e4909e columnFamilyName info 2023-02-13 20:03:54,050 INFO [StoreOpener-fdb64b82c98eff555990616b21e4909e-1] regionserver.HStore(310): Store=fdb64b82c98eff555990616b21e4909e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,051 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/namespace/fdb64b82c98eff555990616b21e4909e 2023-02-13 20:03:54,051 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/namespace/fdb64b82c98eff555990616b21e4909e 2023-02-13 20:03:54,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for fdb64b82c98eff555990616b21e4909e 2023-02-13 20:03:54,055 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/namespace/fdb64b82c98eff555990616b21e4909e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:54,055 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened fdb64b82c98eff555990616b21e4909e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58909104, jitterRate=-0.12218594551086426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:03:54,055 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for fdb64b82c98eff555990616b21e4909e: Running coprocessor pre-open hook at 1676318634047Writing region info on filesystem at 1676318634047Initializing all the Stores at 1676318634048 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318634048Cleaning up temporary data from old regions at 1676318634051 (+3 ms)Cleaning up detritus from prior splits at 1676318634052 (+1 ms)Running coprocessor post-open hooks at 1676318634055 (+3 ms)Region opened successfully at 1676318634055 2023-02-13 20:03:54,056 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e., pid=6, masterSystemTime=1676318634023 2023-02-13 20:03:54,061 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. 2023-02-13 20:03:54,061 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. 2023-02-13 20:03:54,062 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fdb64b82c98eff555990616b21e4909e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:54,062 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318634061"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318634061"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318634061"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318634061"}]},"ts":"1676318634061"} 2023-02-13 20:03:54,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 20:03:54,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure fdb64b82c98eff555990616b21e4909e, server=jenkins-hbase4.apache.org,35759,1676318633044 in 196 msec 2023-02-13 20:03:54,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 20:03:54,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=fdb64b82c98eff555990616b21e4909e, ASSIGN in 360 msec 2023-02-13 20:03:54,069 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:03:54,070 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318634069"}]},"ts":"1676318634069"} 2023-02-13 20:03:54,071 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 20:03:54,073 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:03:54,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 413 msec 2023-02-13 20:03:54,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 20:03:54,163 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:03:54,163 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:54,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:54,167 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44942, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:54,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 20:03:54,178 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:03:54,181 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 12 msec 2023-02-13 20:03:54,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 20:03:54,197 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:03:54,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-13 20:03:54,205 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 20:03:54,207 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 20:03:54,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.108sec 2023-02-13 20:03:54,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 20:03:54,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 20:03:54,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 20:03:54,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43055,1676318632997-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 20:03:54,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43055,1676318632997-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 20:03:54,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 20:03:54,292 DEBUG [Listener at localhost/37999] zookeeper.ReadOnlyZKClient(139): Connect 0x49d796e9 to 127.0.0.1:56374 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:54,297 DEBUG [Listener at localhost/37999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6415355d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:54,299 DEBUG [hconnection-0x6df779fd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:54,301 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40012, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:54,302 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43055,1676318632997 2023-02-13 20:03:54,302 DEBUG [Listener at localhost/37999] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 20:03:54,304 DEBUG [Listener at localhost/37999] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 20:03:54,309 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60802, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 20:03:54,310 INFO [Listener at localhost/37999] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-13 20:03:54,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-13 20:03:54,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 20:03:54,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 93 connection: 172.31.14.131:60802 deadline: 1676318694310, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-13 20:03:54,311 INFO [Listener at localhost/37999] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-13 20:03:54,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:03:54,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:54,315 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:03:54,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-13 20:03:54,316 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:03:54,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:54,322 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:54,322 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:54,322 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:54,322 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:54,322 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:54,322 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:54,322 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:54,322 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:54,323 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9 empty. 2023-02-13 20:03:54,323 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af empty. 2023-02-13 20:03:54,323 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5 empty. 2023-02-13 20:03:54,323 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96 empty. 2023-02-13 20:03:54,323 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d empty. 2023-02-13 20:03:54,323 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:54,323 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:54,323 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:54,323 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd empty. 2023-02-13 20:03:54,323 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7 empty. 2023-02-13 20:03:54,323 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f empty. 2023-02-13 20:03:54,323 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:54,324 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:54,324 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:54,324 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:54,324 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac empty. 2023-02-13 20:03:54,324 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:54,324 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:54,324 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:54,324 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa empty. 2023-02-13 20:03:54,325 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:54,325 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:54,325 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-13 20:03:54,333 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-13 20:03:54,335 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 30abf7b2bd989093bfa8f0915228b4af, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp 2023-02-13 20:03:54,335 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 05b94c5c2cb310d1dbc3f76b21d43ddd, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp 2023-02-13 20:03:54,335 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8283b462cfc3827ec6600a627cdc3ea9, NAME => 'testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp 2023-02-13 20:03:54,342 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,342 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,342 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,343 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 8283b462cfc3827ec6600a627cdc3ea9, disabling compactions & flushes 2023-02-13 20:03:54,343 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 30abf7b2bd989093bfa8f0915228b4af, disabling compactions & flushes 2023-02-13 20:03:54,343 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:54,343 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:54,343 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 05b94c5c2cb310d1dbc3f76b21d43ddd, disabling compactions & flushes 2023-02-13 20:03:54,343 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. after waiting 0 ms 2023-02-13 20:03:54,343 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:54,343 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:54,343 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:54,343 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:54,343 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:54,343 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 30abf7b2bd989093bfa8f0915228b4af: Waiting for close lock at 1676318634343Disabling compacts and flushes for region at 1676318634343Disabling writes for close at 1676318634343Writing region close event to WAL at 1676318634343Closed at 1676318634343 2023-02-13 20:03:54,343 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:54,343 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. after waiting 0 ms 2023-02-13 20:03:54,343 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:54,343 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:54,343 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 8283b462cfc3827ec6600a627cdc3ea9: Waiting for close lock at 1676318634343Disabling compacts and flushes for region at 1676318634343Disabling writes for close at 1676318634343Writing region close event to WAL at 1676318634343Closed at 1676318634343 2023-02-13 20:03:54,344 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. after waiting 0 ms 2023-02-13 20:03:54,344 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6d8af339b8196d932391d64edd665c96, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp 2023-02-13 20:03:54,344 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:54,344 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 41d40ad779288da6affe5207d3bf4cf7, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp 2023-02-13 20:03:54,344 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:54,344 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 05b94c5c2cb310d1dbc3f76b21d43ddd: Waiting for close lock at 1676318634342Disabling compacts and flushes for region at 1676318634342Disabling writes for close at 1676318634344 (+2 ms)Writing region close event to WAL at 1676318634344Closed at 1676318634344 2023-02-13 20:03:54,344 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1f626f495a03c4e88c154830cde7650f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp 2023-02-13 20:03:54,355 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,355 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 6d8af339b8196d932391d64edd665c96, disabling compactions & flushes 2023-02-13 20:03:54,355 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:54,355 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:54,355 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. after waiting 0 ms 2023-02-13 20:03:54,355 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:54,355 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:54,355 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 6d8af339b8196d932391d64edd665c96: Waiting for close lock at 1676318634355Disabling compacts and flushes for region at 1676318634355Disabling writes for close at 1676318634355Writing region close event to WAL at 1676318634355Closed at 1676318634355 2023-02-13 20:03:54,356 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 33fc22da8f96cfa31d8d05d8eda1bd2d, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp 2023-02-13 20:03:54,356 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,356 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 1f626f495a03c4e88c154830cde7650f, disabling compactions & flushes 2023-02-13 20:03:54,356 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:54,356 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:54,356 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. after waiting 0 ms 2023-02-13 20:03:54,356 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:54,356 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:54,356 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 1f626f495a03c4e88c154830cde7650f: Waiting for close lock at 1676318634356Disabling compacts and flushes for region at 1676318634356Disabling writes for close at 1676318634356Writing region close event to WAL at 1676318634356Closed at 1676318634356 2023-02-13 20:03:54,357 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8aae60631241dfab8a874b3907b9e7f5, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp 2023-02-13 20:03:54,358 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,358 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 41d40ad779288da6affe5207d3bf4cf7, disabling compactions & flushes 2023-02-13 20:03:54,358 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:54,358 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:54,358 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. after waiting 0 ms 2023-02-13 20:03:54,358 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:54,359 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:54,359 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 41d40ad779288da6affe5207d3bf4cf7: Waiting for close lock at 1676318634358Disabling compacts and flushes for region at 1676318634358Disabling writes for close at 1676318634358Writing region close event to WAL at 1676318634359 (+1 ms)Closed at 1676318634359 2023-02-13 20:03:54,359 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => aa573645573a18bc6f2a0e4754d288ac, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp 2023-02-13 20:03:54,372 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,372 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 33fc22da8f96cfa31d8d05d8eda1bd2d, disabling compactions & flushes 2023-02-13 20:03:54,372 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:54,372 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:54,372 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. after waiting 0 ms 2023-02-13 20:03:54,372 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:54,372 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:54,372 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 33fc22da8f96cfa31d8d05d8eda1bd2d: Waiting for close lock at 1676318634372Disabling compacts and flushes for region at 1676318634372Disabling writes for close at 1676318634372Writing region close event to WAL at 1676318634372Closed at 1676318634372 2023-02-13 20:03:54,373 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8927c608cb12d2eddba4aa6130140dfa, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp 2023-02-13 20:03:54,388 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,388 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 8aae60631241dfab8a874b3907b9e7f5, disabling compactions & flushes 2023-02-13 20:03:54,388 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:54,389 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:54,389 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. after waiting 0 ms 2023-02-13 20:03:54,389 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:54,389 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:54,389 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 8aae60631241dfab8a874b3907b9e7f5: Waiting for close lock at 1676318634388Disabling compacts and flushes for region at 1676318634388Disabling writes for close at 1676318634389 (+1 ms)Writing region close event to WAL at 1676318634389Closed at 1676318634389 2023-02-13 20:03:54,392 INFO [RS:1;jenkins-hbase4:35987] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35987%2C1676318633072, suffix=, logDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/WALs/jenkins-hbase4.apache.org,35987,1676318633072, archiveDir=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/oldWALs, maxLogs=32 2023-02-13 20:03:54,393 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,393 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing aa573645573a18bc6f2a0e4754d288ac, disabling compactions & flushes 2023-02-13 20:03:54,393 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:54,393 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:54,393 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. after waiting 0 ms 2023-02-13 20:03:54,393 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:54,393 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:54,393 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for aa573645573a18bc6f2a0e4754d288ac: Waiting for close lock at 1676318634393Disabling compacts and flushes for region at 1676318634393Disabling writes for close at 1676318634393Writing region close event to WAL at 1676318634393Closed at 1676318634393 2023-02-13 20:03:54,402 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,402 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 8927c608cb12d2eddba4aa6130140dfa, disabling compactions & flushes 2023-02-13 20:03:54,403 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:54,403 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:54,403 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. after waiting 0 ms 2023-02-13 20:03:54,403 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:54,403 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:54,403 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 8927c608cb12d2eddba4aa6130140dfa: Waiting for close lock at 1676318634402Disabling compacts and flushes for region at 1676318634402Disabling writes for close at 1676318634403 (+1 ms)Writing region close event to WAL at 1676318634403Closed at 1676318634403 2023-02-13 20:03:54,405 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:03:54,408 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35133,DS-38d83e0c-9884-4aff-bb17-780d05719599,DISK] 2023-02-13 20:03:54,409 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34561,DS-9bcd6318-64e2-4b95-b6f1-b26a4ddfa232,DISK] 2023-02-13 20:03:54,410 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318634410"}]},"ts":"1676318634410"} 2023-02-13 20:03:54,410 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676318634410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318634410"}]},"ts":"1676318634410"} 2023-02-13 20:03:54,410 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318634410"}]},"ts":"1676318634410"} 2023-02-13 20:03:54,410 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318634410"}]},"ts":"1676318634410"} 2023-02-13 20:03:54,410 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318634410"}]},"ts":"1676318634410"} 2023-02-13 20:03:54,411 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318634410"}]},"ts":"1676318634410"} 2023-02-13 20:03:54,411 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318634410"}]},"ts":"1676318634410"} 2023-02-13 20:03:54,411 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318634410"}]},"ts":"1676318634410"} 2023-02-13 20:03:54,411 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318634410"}]},"ts":"1676318634410"} 2023-02-13 20:03:54,411 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676318634410"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318634410"}]},"ts":"1676318634410"} 2023-02-13 20:03:54,411 INFO [RS:1;jenkins-hbase4:35987] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/WALs/jenkins-hbase4.apache.org,35987,1676318633072/jenkins-hbase4.apache.org%2C35987%2C1676318633072.1676318634392 2023-02-13 20:03:54,411 DEBUG [RS:1;jenkins-hbase4:35987] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35133,DS-38d83e0c-9884-4aff-bb17-780d05719599,DISK], DatanodeInfoWithStorage[127.0.0.1:34561,DS-9bcd6318-64e2-4b95-b6f1-b26a4ddfa232,DISK]] 2023-02-13 20:03:54,413 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 20:03:54,414 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:03:54,414 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318634414"}]},"ts":"1676318634414"} 2023-02-13 20:03:54,416 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-13 20:03:54,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:54,419 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:03:54,425 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:03:54,425 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:03:54,425 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:03:54,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8283b462cfc3827ec6600a627cdc3ea9, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=05b94c5c2cb310d1dbc3f76b21d43ddd, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=30abf7b2bd989093bfa8f0915228b4af, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=41d40ad779288da6affe5207d3bf4cf7, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6d8af339b8196d932391d64edd665c96, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f626f495a03c4e88c154830cde7650f, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33fc22da8f96cfa31d8d05d8eda1bd2d, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8aae60631241dfab8a874b3907b9e7f5, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa573645573a18bc6f2a0e4754d288ac, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8927c608cb12d2eddba4aa6130140dfa, ASSIGN}] 2023-02-13 20:03:54,428 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8927c608cb12d2eddba4aa6130140dfa, ASSIGN 2023-02-13 20:03:54,428 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8aae60631241dfab8a874b3907b9e7f5, ASSIGN 2023-02-13 20:03:54,428 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa573645573a18bc6f2a0e4754d288ac, ASSIGN 2023-02-13 20:03:54,428 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33fc22da8f96cfa31d8d05d8eda1bd2d, ASSIGN 2023-02-13 20:03:54,429 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f626f495a03c4e88c154830cde7650f, ASSIGN 2023-02-13 20:03:54,429 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa573645573a18bc6f2a0e4754d288ac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35987,1676318633072; forceNewPlan=false, retain=false 2023-02-13 20:03:54,429 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8aae60631241dfab8a874b3907b9e7f5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35759,1676318633044; forceNewPlan=false, retain=false 2023-02-13 20:03:54,429 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33fc22da8f96cfa31d8d05d8eda1bd2d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35987,1676318633072; forceNewPlan=false, retain=false 2023-02-13 20:03:54,429 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8927c608cb12d2eddba4aa6130140dfa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35759,1676318633044; forceNewPlan=false, retain=false 2023-02-13 20:03:54,430 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f626f495a03c4e88c154830cde7650f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35987,1676318633072; forceNewPlan=false, retain=false 2023-02-13 20:03:54,430 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6d8af339b8196d932391d64edd665c96, ASSIGN 2023-02-13 20:03:54,430 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=41d40ad779288da6affe5207d3bf4cf7, ASSIGN 2023-02-13 20:03:54,430 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=30abf7b2bd989093bfa8f0915228b4af, ASSIGN 2023-02-13 20:03:54,430 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=05b94c5c2cb310d1dbc3f76b21d43ddd, ASSIGN 2023-02-13 20:03:54,430 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6d8af339b8196d932391d64edd665c96, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35759,1676318633044; forceNewPlan=false, retain=false 2023-02-13 20:03:54,430 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8283b462cfc3827ec6600a627cdc3ea9, ASSIGN 2023-02-13 20:03:54,431 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=41d40ad779288da6affe5207d3bf4cf7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35759,1676318633044; forceNewPlan=false, retain=false 2023-02-13 20:03:54,431 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=30abf7b2bd989093bfa8f0915228b4af, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35987,1676318633072; forceNewPlan=false, retain=false 2023-02-13 20:03:54,431 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=05b94c5c2cb310d1dbc3f76b21d43ddd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35987,1676318633072; forceNewPlan=false, retain=false 2023-02-13 20:03:54,431 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8283b462cfc3827ec6600a627cdc3ea9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35759,1676318633044; forceNewPlan=false, retain=false 2023-02-13 20:03:54,579 INFO [jenkins-hbase4:43055] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 20:03:54,585 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=33fc22da8f96cfa31d8d05d8eda1bd2d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:54,585 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=30abf7b2bd989093bfa8f0915228b4af, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:54,585 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=aa573645573a18bc6f2a0e4754d288ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:54,586 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318634585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318634585"}]},"ts":"1676318634585"} 2023-02-13 20:03:54,585 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1f626f495a03c4e88c154830cde7650f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:54,585 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=05b94c5c2cb310d1dbc3f76b21d43ddd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:54,586 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318634585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318634585"}]},"ts":"1676318634585"} 2023-02-13 20:03:54,586 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318634585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318634585"}]},"ts":"1676318634585"} 2023-02-13 20:03:54,586 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318634585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318634585"}]},"ts":"1676318634585"} 2023-02-13 20:03:54,586 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634585"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318634585"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318634585"}]},"ts":"1676318634585"} 2023-02-13 20:03:54,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=13, state=RUNNABLE; OpenRegionProcedure 30abf7b2bd989093bfa8f0915228b4af, server=jenkins-hbase4.apache.org,35987,1676318633072}] 2023-02-13 20:03:54,588 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 1f626f495a03c4e88c154830cde7650f, server=jenkins-hbase4.apache.org,35987,1676318633072}] 2023-02-13 20:03:54,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=19, state=RUNNABLE; OpenRegionProcedure aa573645573a18bc6f2a0e4754d288ac, server=jenkins-hbase4.apache.org,35987,1676318633072}] 2023-02-13 20:03:54,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=17, state=RUNNABLE; OpenRegionProcedure 33fc22da8f96cfa31d8d05d8eda1bd2d, server=jenkins-hbase4.apache.org,35987,1676318633072}] 2023-02-13 20:03:54,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=12, state=RUNNABLE; OpenRegionProcedure 05b94c5c2cb310d1dbc3f76b21d43ddd, server=jenkins-hbase4.apache.org,35987,1676318633072}] 2023-02-13 20:03:54,591 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8927c608cb12d2eddba4aa6130140dfa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:54,591 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676318634591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318634591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318634591"}]},"ts":"1676318634591"} 2023-02-13 20:03:54,592 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6d8af339b8196d932391d64edd665c96, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:54,592 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=8aae60631241dfab8a874b3907b9e7f5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:54,592 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634592"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318634592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318634592"}]},"ts":"1676318634592"} 2023-02-13 20:03:54,593 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634592"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318634592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318634592"}]},"ts":"1676318634592"} 2023-02-13 20:03:54,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure 8927c608cb12d2eddba4aa6130140dfa, server=jenkins-hbase4.apache.org,35759,1676318633044}] 2023-02-13 20:03:54,593 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=41d40ad779288da6affe5207d3bf4cf7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:54,593 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634593"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318634593"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318634593"}]},"ts":"1676318634593"} 2023-02-13 20:03:54,594 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=8283b462cfc3827ec6600a627cdc3ea9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:54,594 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676318634594"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318634594"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318634594"}]},"ts":"1676318634594"} 2023-02-13 20:03:54,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=15, state=RUNNABLE; OpenRegionProcedure 6d8af339b8196d932391d64edd665c96, server=jenkins-hbase4.apache.org,35759,1676318633044}] 2023-02-13 20:03:54,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=18, state=RUNNABLE; OpenRegionProcedure 8aae60631241dfab8a874b3907b9e7f5, server=jenkins-hbase4.apache.org,35759,1676318633044}] 2023-02-13 20:03:54,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=14, state=RUNNABLE; OpenRegionProcedure 41d40ad779288da6affe5207d3bf4cf7, server=jenkins-hbase4.apache.org,35759,1676318633044}] 2023-02-13 20:03:54,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=11, state=RUNNABLE; OpenRegionProcedure 8283b462cfc3827ec6600a627cdc3ea9, server=jenkins-hbase4.apache.org,35759,1676318633044}] 2023-02-13 20:03:54,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:54,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:54,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1f626f495a03c4e88c154830cde7650f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 20:03:54,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:54,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:54,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:54,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:54,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6d8af339b8196d932391d64edd665c96, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 20:03:54,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:54,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:54,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:54,790 INFO [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:54,802 DEBUG [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1 2023-02-13 20:03:54,802 DEBUG [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1 2023-02-13 20:03:54,802 INFO [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f626f495a03c4e88c154830cde7650f columnFamilyName f1 2023-02-13 20:03:54,803 INFO [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] regionserver.HStore(310): Store=1f626f495a03c4e88c154830cde7650f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,803 INFO [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:54,804 DEBUG [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2 2023-02-13 20:03:54,805 DEBUG [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2 2023-02-13 20:03:54,805 INFO [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f626f495a03c4e88c154830cde7650f columnFamilyName f2 2023-02-13 20:03:54,805 INFO [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] regionserver.HStore(310): Store=1f626f495a03c4e88c154830cde7650f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:54,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:54,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:54,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:54,811 INFO [StoreOpener-6d8af339b8196d932391d64edd665c96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:54,812 DEBUG [StoreOpener-6d8af339b8196d932391d64edd665c96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1 2023-02-13 20:03:54,812 DEBUG [StoreOpener-6d8af339b8196d932391d64edd665c96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1 2023-02-13 20:03:54,813 INFO [StoreOpener-6d8af339b8196d932391d64edd665c96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d8af339b8196d932391d64edd665c96 columnFamilyName f1 2023-02-13 20:03:54,813 INFO [StoreOpener-6d8af339b8196d932391d64edd665c96-1] regionserver.HStore(310): Store=6d8af339b8196d932391d64edd665c96/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,813 INFO [StoreOpener-6d8af339b8196d932391d64edd665c96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:54,815 DEBUG [StoreOpener-6d8af339b8196d932391d64edd665c96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2 2023-02-13 20:03:54,815 DEBUG [StoreOpener-6d8af339b8196d932391d64edd665c96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2 2023-02-13 20:03:54,815 INFO [StoreOpener-6d8af339b8196d932391d64edd665c96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d8af339b8196d932391d64edd665c96 columnFamilyName f2 2023-02-13 20:03:54,815 INFO [StoreOpener-6d8af339b8196d932391d64edd665c96-1] regionserver.HStore(310): Store=6d8af339b8196d932391d64edd665c96/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:54,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:54,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:54,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:54,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:54,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1f626f495a03c4e88c154830cde7650f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65850019, jitterRate=-0.018758252263069153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:54,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1f626f495a03c4e88c154830cde7650f: Running coprocessor pre-open hook at 1676318634769Writing region info on filesystem at 1676318634769Initializing all the Stores at 1676318634770 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634770Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634788 (+18 ms)Cleaning up temporary data from old regions at 1676318634807 (+19 ms)Cleaning up detritus from prior splits at 1676318634808 (+1 ms)Running coprocessor post-open hooks at 1676318634826 (+18 ms)Region opened successfully at 1676318634826 2023-02-13 20:03:54,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:54,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f., pid=22, masterSystemTime=1676318634751 2023-02-13 20:03:54,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 6d8af339b8196d932391d64edd665c96; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66512378, jitterRate=-0.008888334035873413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:54,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 6d8af339b8196d932391d64edd665c96: Running coprocessor pre-open hook at 1676318634781Writing region info on filesystem at 1676318634781Initializing all the Stores at 1676318634788 (+7 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634788Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634800 (+12 ms)Cleaning up temporary data from old regions at 1676318634822 (+22 ms)Cleaning up detritus from prior splits at 1676318634822Running coprocessor post-open hooks at 1676318634828 (+6 ms)Region opened successfully at 1676318634828 2023-02-13 20:03:54,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96., pid=27, masterSystemTime=1676318634751 2023-02-13 20:03:54,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:54,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:54,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:54,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 33fc22da8f96cfa31d8d05d8eda1bd2d, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 20:03:54,830 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=1f626f495a03c4e88c154830cde7650f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:54,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:54,830 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634830"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318634830"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318634830"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318634830"}]},"ts":"1676318634830"} 2023-02-13 20:03:54,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:54,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:54,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:54,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:54,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:54,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8aae60631241dfab8a874b3907b9e7f5, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 20:03:54,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:54,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:54,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:54,832 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=6d8af339b8196d932391d64edd665c96, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:54,832 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634832"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318634832"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318634832"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318634832"}]},"ts":"1676318634832"} 2023-02-13 20:03:54,833 INFO [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:54,833 INFO [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:54,834 DEBUG [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1 2023-02-13 20:03:54,834 DEBUG [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1 2023-02-13 20:03:54,834 DEBUG [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1 2023-02-13 20:03:54,834 DEBUG [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1 2023-02-13 20:03:54,835 INFO [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8aae60631241dfab8a874b3907b9e7f5 columnFamilyName f1 2023-02-13 20:03:54,835 INFO [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33fc22da8f96cfa31d8d05d8eda1bd2d columnFamilyName f1 2023-02-13 20:03:54,835 INFO [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] regionserver.HStore(310): Store=8aae60631241dfab8a874b3907b9e7f5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,835 INFO [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] regionserver.HStore(310): Store=33fc22da8f96cfa31d8d05d8eda1bd2d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,835 INFO [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:54,835 INFO [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:54,837 DEBUG [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2 2023-02-13 20:03:54,837 DEBUG [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2 2023-02-13 20:03:54,837 INFO [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8aae60631241dfab8a874b3907b9e7f5 columnFamilyName f2 2023-02-13 20:03:54,837 INFO [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] regionserver.HStore(310): Store=8aae60631241dfab8a874b3907b9e7f5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,838 DEBUG [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2 2023-02-13 20:03:54,838 DEBUG [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2 2023-02-13 20:03:54,838 INFO [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33fc22da8f96cfa31d8d05d8eda1bd2d columnFamilyName f2 2023-02-13 20:03:54,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:54,838 INFO [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] regionserver.HStore(310): Store=33fc22da8f96cfa31d8d05d8eda1bd2d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:54,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:54,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:54,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-13 20:03:54,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 1f626f495a03c4e88c154830cde7650f, server=jenkins-hbase4.apache.org,35987,1676318633072 in 245 msec 2023-02-13 20:03:54,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:54,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=15 2023-02-13 20:03:54,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=15, state=SUCCESS; OpenRegionProcedure 6d8af339b8196d932391d64edd665c96, server=jenkins-hbase4.apache.org,35759,1676318633044 in 239 msec 2023-02-13 20:03:54,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f626f495a03c4e88c154830cde7650f, ASSIGN in 415 msec 2023-02-13 20:03:54,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:54,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6d8af339b8196d932391d64edd665c96, ASSIGN in 415 msec 2023-02-13 20:03:54,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:54,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:54,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:54,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8aae60631241dfab8a874b3907b9e7f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70571902, jitterRate=0.0516032874584198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:54,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8aae60631241dfab8a874b3907b9e7f5: Running coprocessor pre-open hook at 1676318634831Writing region info on filesystem at 1676318634831Initializing all the Stores at 1676318634832 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634832Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634833 (+1 ms)Cleaning up temporary data from old regions at 1676318634839 (+6 ms)Cleaning up detritus from prior splits at 1676318634840 (+1 ms)Running coprocessor post-open hooks at 1676318634845 (+5 ms)Region opened successfully at 1676318634845 2023-02-13 20:03:54,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5., pid=28, masterSystemTime=1676318634751 2023-02-13 20:03:54,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:54,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:54,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:54,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 41d40ad779288da6affe5207d3bf4cf7, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 20:03:54,847 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=8aae60631241dfab8a874b3907b9e7f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:54,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:54,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:54,847 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634847"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318634847"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318634847"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318634847"}]},"ts":"1676318634847"} 2023-02-13 20:03:54,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:54,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=18 2023-02-13 20:03:54,850 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=18, state=SUCCESS; OpenRegionProcedure 8aae60631241dfab8a874b3907b9e7f5, server=jenkins-hbase4.apache.org,35759,1676318633044 in 253 msec 2023-02-13 20:03:54,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8aae60631241dfab8a874b3907b9e7f5, ASSIGN in 424 msec 2023-02-13 20:03:54,852 INFO [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:54,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:54,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 33fc22da8f96cfa31d8d05d8eda1bd2d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74706956, jitterRate=0.11322039365768433}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:54,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 33fc22da8f96cfa31d8d05d8eda1bd2d: Running coprocessor pre-open hook at 1676318634831Writing region info on filesystem at 1676318634831Initializing all the Stores at 1676318634832 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634832Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634833 (+1 ms)Cleaning up temporary data from old regions at 1676318634840 (+7 ms)Cleaning up detritus from prior splits at 1676318634841 (+1 ms)Running coprocessor post-open hooks at 1676318634853 (+12 ms)Region opened successfully at 1676318634853 2023-02-13 20:03:54,853 DEBUG [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1 2023-02-13 20:03:54,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d., pid=24, masterSystemTime=1676318634751 2023-02-13 20:03:54,853 DEBUG [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1 2023-02-13 20:03:54,854 INFO [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41d40ad779288da6affe5207d3bf4cf7 columnFamilyName f1 2023-02-13 20:03:54,854 INFO [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] regionserver.HStore(310): Store=41d40ad779288da6affe5207d3bf4cf7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,854 INFO [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:54,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:54,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:54,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:54,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aa573645573a18bc6f2a0e4754d288ac, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 20:03:54,855 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=33fc22da8f96cfa31d8d05d8eda1bd2d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:54,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:54,855 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634855"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318634855"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318634855"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318634855"}]},"ts":"1676318634855"} 2023-02-13 20:03:54,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:54,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:54,855 DEBUG [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2 2023-02-13 20:03:54,855 DEBUG [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2 2023-02-13 20:03:54,856 INFO [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41d40ad779288da6affe5207d3bf4cf7 columnFamilyName f2 2023-02-13 20:03:54,856 INFO [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] regionserver.HStore(310): Store=41d40ad779288da6affe5207d3bf4cf7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,856 INFO [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:54,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:54,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:54,857 DEBUG [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1 2023-02-13 20:03:54,857 DEBUG [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1 2023-02-13 20:03:54,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=17 2023-02-13 20:03:54,858 INFO [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa573645573a18bc6f2a0e4754d288ac columnFamilyName f1 2023-02-13 20:03:54,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=17, state=SUCCESS; OpenRegionProcedure 33fc22da8f96cfa31d8d05d8eda1bd2d, server=jenkins-hbase4.apache.org,35987,1676318633072 in 266 msec 2023-02-13 20:03:54,858 INFO [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] regionserver.HStore(310): Store=aa573645573a18bc6f2a0e4754d288ac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,858 INFO [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:54,859 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33fc22da8f96cfa31d8d05d8eda1bd2d, ASSIGN in 432 msec 2023-02-13 20:03:54,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:54,859 DEBUG [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2 2023-02-13 20:03:54,859 DEBUG [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2 2023-02-13 20:03:54,860 INFO [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa573645573a18bc6f2a0e4754d288ac columnFamilyName f2 2023-02-13 20:03:54,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:54,860 INFO [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] regionserver.HStore(310): Store=aa573645573a18bc6f2a0e4754d288ac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:54,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:54,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:54,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 41d40ad779288da6affe5207d3bf4cf7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73840675, jitterRate=0.10031180083751678}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:54,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 41d40ad779288da6affe5207d3bf4cf7: Running coprocessor pre-open hook at 1676318634847Writing region info on filesystem at 1676318634847Initializing all the Stores at 1676318634848 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634848Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634852 (+4 ms)Cleaning up temporary data from old regions at 1676318634858 (+6 ms)Cleaning up detritus from prior splits at 1676318634858Running coprocessor post-open hooks at 1676318634862 (+4 ms)Region opened successfully at 1676318634862 2023-02-13 20:03:54,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:54,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7., pid=29, masterSystemTime=1676318634751 2023-02-13 20:03:54,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:54,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:54,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:54,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:54,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8283b462cfc3827ec6600a627cdc3ea9, NAME => 'testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 20:03:54,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:54,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:54,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:54,865 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=41d40ad779288da6affe5207d3bf4cf7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:54,865 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634865"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318634865"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318634865"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318634865"}]},"ts":"1676318634865"} 2023-02-13 20:03:54,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:54,866 INFO [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:54,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened aa573645573a18bc6f2a0e4754d288ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68656206, jitterRate=0.02305719256401062}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:54,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for aa573645573a18bc6f2a0e4754d288ac: Running coprocessor pre-open hook at 1676318634855Writing region info on filesystem at 1676318634855Initializing all the Stores at 1676318634856 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634856Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634856Cleaning up temporary data from old regions at 1676318634861 (+5 ms)Cleaning up detritus from prior splits at 1676318634862 (+1 ms)Running coprocessor post-open hooks at 1676318634867 (+5 ms)Region opened successfully at 1676318634867 2023-02-13 20:03:54,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac., pid=23, masterSystemTime=1676318634751 2023-02-13 20:03:54,868 DEBUG [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9/f1 2023-02-13 20:03:54,868 DEBUG [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9/f1 2023-02-13 20:03:54,868 INFO [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8283b462cfc3827ec6600a627cdc3ea9 columnFamilyName f1 2023-02-13 20:03:54,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:54,869 INFO [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] regionserver.HStore(310): Store=8283b462cfc3827ec6600a627cdc3ea9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:54,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:54,869 INFO [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:54,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 30abf7b2bd989093bfa8f0915228b4af, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 20:03:54,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:54,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:54,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:54,870 DEBUG [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9/f2 2023-02-13 20:03:54,870 DEBUG [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9/f2 2023-02-13 20:03:54,870 INFO [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8283b462cfc3827ec6600a627cdc3ea9 columnFamilyName f2 2023-02-13 20:03:54,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=14 2023-02-13 20:03:54,871 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=aa573645573a18bc6f2a0e4754d288ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:54,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=14, state=SUCCESS; OpenRegionProcedure 41d40ad779288da6affe5207d3bf4cf7, server=jenkins-hbase4.apache.org,35759,1676318633044 in 272 msec 2023-02-13 20:03:54,871 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634871"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318634871"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318634871"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318634871"}]},"ts":"1676318634871"} 2023-02-13 20:03:54,871 INFO [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] regionserver.HStore(310): Store=8283b462cfc3827ec6600a627cdc3ea9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:54,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=41d40ad779288da6affe5207d3bf4cf7, ASSIGN in 445 msec 2023-02-13 20:03:54,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:54,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=19 2023-02-13 20:03:54,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=19, state=SUCCESS; OpenRegionProcedure aa573645573a18bc6f2a0e4754d288ac, server=jenkins-hbase4.apache.org,35987,1676318633072 in 284 msec 2023-02-13 20:03:54,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa573645573a18bc6f2a0e4754d288ac, ASSIGN in 449 msec 2023-02-13 20:03:54,876 INFO [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:54,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:54,882 DEBUG [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1 2023-02-13 20:03:54,882 DEBUG [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1 2023-02-13 20:03:54,882 INFO [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30abf7b2bd989093bfa8f0915228b4af columnFamilyName f1 2023-02-13 20:03:54,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:54,882 INFO [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] regionserver.HStore(310): Store=30abf7b2bd989093bfa8f0915228b4af/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,882 INFO [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:54,883 DEBUG [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2 2023-02-13 20:03:54,884 DEBUG [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2 2023-02-13 20:03:54,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:54,884 INFO [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30abf7b2bd989093bfa8f0915228b4af columnFamilyName f2 2023-02-13 20:03:54,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8283b462cfc3827ec6600a627cdc3ea9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71154045, jitterRate=0.060277894139289856}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:54,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8283b462cfc3827ec6600a627cdc3ea9: Running coprocessor pre-open hook at 1676318634865Writing region info on filesystem at 1676318634865Initializing all the Stores at 1676318634866 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634866Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634866Cleaning up temporary data from old regions at 1676318634873 (+7 ms)Cleaning up detritus from prior splits at 1676318634876 (+3 ms)Running coprocessor post-open hooks at 1676318634884 (+8 ms)Region opened successfully at 1676318634884 2023-02-13 20:03:54,884 INFO [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] regionserver.HStore(310): Store=30abf7b2bd989093bfa8f0915228b4af/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9., pid=30, masterSystemTime=1676318634751 2023-02-13 20:03:54,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:54,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:54,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:54,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:54,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:54,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8927c608cb12d2eddba4aa6130140dfa, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 20:03:54,887 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=8283b462cfc3827ec6600a627cdc3ea9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:54,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:54,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:54,887 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676318634887"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318634887"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318634887"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318634887"}]},"ts":"1676318634887"} 2023-02-13 20:03:54,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:54,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:54,888 INFO [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:54,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:54,890 DEBUG [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa/f1 2023-02-13 20:03:54,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=11 2023-02-13 20:03:54,890 DEBUG [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa/f1 2023-02-13 20:03:54,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=11, state=SUCCESS; OpenRegionProcedure 8283b462cfc3827ec6600a627cdc3ea9, server=jenkins-hbase4.apache.org,35759,1676318633044 in 291 msec 2023-02-13 20:03:54,890 INFO [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8927c608cb12d2eddba4aa6130140dfa columnFamilyName f1 2023-02-13 20:03:54,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:54,891 INFO [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] regionserver.HStore(310): Store=8927c608cb12d2eddba4aa6130140dfa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8283b462cfc3827ec6600a627cdc3ea9, ASSIGN in 464 msec 2023-02-13 20:03:54,891 INFO [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:54,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 30abf7b2bd989093bfa8f0915228b4af; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74327852, jitterRate=0.1075713038444519}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:54,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 30abf7b2bd989093bfa8f0915228b4af: Running coprocessor pre-open hook at 1676318634870Writing region info on filesystem at 1676318634870Initializing all the Stores at 1676318634872 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634872Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634876 (+4 ms)Cleaning up temporary data from old regions at 1676318634886 (+10 ms)Cleaning up detritus from prior splits at 1676318634886Running coprocessor post-open hooks at 1676318634891 (+5 ms)Region opened successfully at 1676318634891 2023-02-13 20:03:54,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af., pid=21, masterSystemTime=1676318634751 2023-02-13 20:03:54,892 DEBUG [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa/f2 2023-02-13 20:03:54,892 DEBUG [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa/f2 2023-02-13 20:03:54,892 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 20:03:54,893 INFO [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8927c608cb12d2eddba4aa6130140dfa columnFamilyName f2 2023-02-13 20:03:54,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:54,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:54,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:54,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 05b94c5c2cb310d1dbc3f76b21d43ddd, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 20:03:54,894 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=30abf7b2bd989093bfa8f0915228b4af, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:54,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:54,894 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634894"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318634894"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318634894"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318634894"}]},"ts":"1676318634894"} 2023-02-13 20:03:54,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:54,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:54,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:54,898 INFO [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:54,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=13 2023-02-13 20:03:54,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=13, state=SUCCESS; OpenRegionProcedure 30abf7b2bd989093bfa8f0915228b4af, server=jenkins-hbase4.apache.org,35987,1676318633072 in 309 msec 2023-02-13 20:03:54,900 DEBUG [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1 2023-02-13 20:03:54,900 DEBUG [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1 2023-02-13 20:03:54,900 INFO [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05b94c5c2cb310d1dbc3f76b21d43ddd columnFamilyName f1 2023-02-13 20:03:54,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=30abf7b2bd989093bfa8f0915228b4af, ASSIGN in 473 msec 2023-02-13 20:03:54,901 INFO [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] regionserver.HStore(310): Store=05b94c5c2cb310d1dbc3f76b21d43ddd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,901 INFO [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:54,902 DEBUG [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2 2023-02-13 20:03:54,902 DEBUG [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2 2023-02-13 20:03:54,902 INFO [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05b94c5c2cb310d1dbc3f76b21d43ddd columnFamilyName f2 2023-02-13 20:03:54,903 INFO [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] regionserver.HStore(310): Store=05b94c5c2cb310d1dbc3f76b21d43ddd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,904 INFO [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] regionserver.HStore(310): Store=8927c608cb12d2eddba4aa6130140dfa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:54,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:54,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:54,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:54,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:54,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:54,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:54,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:54,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:54,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:54,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:54,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8927c608cb12d2eddba4aa6130140dfa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69805538, jitterRate=0.040183573961257935}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:54,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8927c608cb12d2eddba4aa6130140dfa: Running coprocessor pre-open hook at 1676318634887Writing region info on filesystem at 1676318634887Initializing all the Stores at 1676318634888 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634888Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634888Cleaning up temporary data from old regions at 1676318634910 (+22 ms)Cleaning up detritus from prior splits at 1676318634910Running coprocessor post-open hooks at 1676318634924 (+14 ms)Region opened successfully at 1676318634924 2023-02-13 20:03:54,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa., pid=26, masterSystemTime=1676318634751 2023-02-13 20:03:54,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:54,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:54,927 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8927c608cb12d2eddba4aa6130140dfa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:54,927 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676318634926"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318634926"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318634926"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318634926"}]},"ts":"1676318634926"} 2023-02-13 20:03:54,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:03:54,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 05b94c5c2cb310d1dbc3f76b21d43ddd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72674491, jitterRate=0.08293430507183075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:54,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 05b94c5c2cb310d1dbc3f76b21d43ddd: Running coprocessor pre-open hook at 1676318634895Writing region info on filesystem at 1676318634895Initializing all the Stores at 1676318634897 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634897Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318634897Cleaning up temporary data from old regions at 1676318634910 (+13 ms)Cleaning up detritus from prior splits at 1676318634910Running coprocessor post-open hooks at 1676318634929 (+19 ms)Region opened successfully at 1676318634929 2023-02-13 20:03:54,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd., pid=25, masterSystemTime=1676318634751 2023-02-13 20:03:54,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-13 20:03:54,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure 8927c608cb12d2eddba4aa6130140dfa, server=jenkins-hbase4.apache.org,35759,1676318633044 in 335 msec 2023-02-13 20:03:54,932 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8927c608cb12d2eddba4aa6130140dfa, ASSIGN in 504 msec 2023-02-13 20:03:54,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:54,932 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=05b94c5c2cb310d1dbc3f76b21d43ddd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:54,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:54,932 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318634932"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318634932"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318634932"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318634932"}]},"ts":"1676318634932"} 2023-02-13 20:03:54,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=12 2023-02-13 20:03:54,938 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=12, state=SUCCESS; OpenRegionProcedure 05b94c5c2cb310d1dbc3f76b21d43ddd, server=jenkins-hbase4.apache.org,35987,1676318633072 in 346 msec 2023-02-13 20:03:54,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=10 2023-02-13 20:03:54,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=05b94c5c2cb310d1dbc3f76b21d43ddd, ASSIGN in 512 msec 2023-02-13 20:03:54,941 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:03:54,941 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318634941"}]},"ts":"1676318634941"} 2023-02-13 20:03:54,942 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-13 20:03:54,944 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:03:54,946 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 631 msec 2023-02-13 20:03:55,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:03:55,422 INFO [Listener at localhost/37999] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-13 20:03:55,422 DEBUG [Listener at localhost/37999] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-13 20:03:55,422 INFO [Listener at localhost/37999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:03:55,425 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-13 20:03:55,425 INFO [Listener at localhost/37999] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:03:55,425 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-13 20:03:55,425 INFO [Listener at localhost/37999] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 20:03:55,457 DEBUG [hconnection-0x6df779fd-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:55,464 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44954, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:55,467 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35759] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:55,478 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35987] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:55,612 INFO [Listener at localhost/37999] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 20:03:55,612 INFO [Listener at localhost/37999] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 20:03:55,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 20:03:55,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676318635613 (current time:1676318635613). 2023-02-13 20:03:55,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 20:03:55,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] zookeeper.ReadOnlyZKClient(139): Connect 0x0517189c to 127.0.0.1:56374 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:03:55,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@290455c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:03:55,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:03:55,622 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40014, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:03:55,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0517189c to 127.0.0.1:56374 2023-02-13 20:03:55,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:55,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 20:03:55,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 20:03:55,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 20:03:55,627 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 20:03:55,628 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676319235628 2023-02-13 20:03:55,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 20:03:55,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,630 DEBUG [Listener at localhost/37999] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 20:03:55,630 DEBUG [Listener at localhost/37999] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 20:03:55,630 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 20:03:55,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 20:03:55,632 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 6 msec 2023-02-13 20:03:55,632 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 20:03:55,633 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676319235633 2023-02-13 20:03:55,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,652 INFO [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-13 20:03:55,652 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:03:55,653 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-13 20:03:55,653 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 20:03:55,727 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,727 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,728 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:55,728 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:55,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:55,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:55,728 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:55,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:55,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:55,729 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:55,729 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:55,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,729 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:55,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,729 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:03:55,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-13 20:03:55,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-13 20:03:55,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-13 20:03:55,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-13 20:03:55,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-13 20:03:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:03:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-13 20:03:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:03:55,732 DEBUG [Listener at localhost/37999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 20:03:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 20:03:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 20:03:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 20:03:55,733 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35987,1676318633072' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 20:03:55,733 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35759,1676318633044' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 20:03:55,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 20:03:55,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:03:55,734 DEBUG [Listener at localhost/37999] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 20:03:55,734 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,734 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:55,735 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:55,735 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,735 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:55,735 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:55,735 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,735 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:55,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35987,1676318633072' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 20:03:55,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2288182c[Count = 1] remaining members to acquire global barrier 2023-02-13 20:03:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:55,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:55,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:55,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:55,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35759,1676318633044' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 20:03:55,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2288182c[Count = 0] remaining members to acquire global barrier 2023-02-13 20:03:55,738 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 20:03:55,738 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,740 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,740 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,740 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 20:03:55,740 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 20:03:55,740 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:55,741 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:55,741 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. started... 2023-02-13 20:03:55,741 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:55,742 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. started... 2023-02-13 20:03:55,742 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 6d8af339b8196d932391d64edd665c96 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:55,742 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:55,742 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:55,743 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 33fc22da8f96cfa31d8d05d8eda1bd2d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:55,743 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:55,742 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 20:03:55,743 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. started... 2023-02-13 20:03:55,743 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 20:03:55,743 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. started... 2023-02-13 20:03:55,743 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. started... 2023-02-13 20:03:55,744 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 41d40ad779288da6affe5207d3bf4cf7 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:55,743 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:55,745 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. started... 2023-02-13 20:03:55,743 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:03:55,742 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 20:03:55,746 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 20:03:55,745 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 8283b462cfc3827ec6600a627cdc3ea9: 2023-02-13 20:03:55,745 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HRegion(2744): Flushing aa573645573a18bc6f2a0e4754d288ac 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 20:03:55,746 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 30abf7b2bd989093bfa8f0915228b4af 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:55,746 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,747 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:55,747 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 20:03:55,747 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 20:03:55,764 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. completed. 2023-02-13 20:03:55,764 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:55,764 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:55,764 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 20:03:55,764 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. started... 2023-02-13 20:03:55,769 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 8aae60631241dfab8a874b3907b9e7f5 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:55,780 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/.tmp/f1/d801a66ba06f45a5ac7fbef69bf97237 2023-02-13 20:03:55,788 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/.tmp/f1/d6fbd7d7c99f41e6b4489bc643583a1e 2023-02-13 20:03:55,804 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/.tmp/f1/fefc705c2ce94398b30c69355af2e379 2023-02-13 20:03:55,808 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/.tmp/f1/2922203fd92b43bd9b3ebb1a9b86b8bd 2023-02-13 20:03:55,831 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/.tmp/f1/dd5b0f7f9dab4e80b6cc40404e2d6141 2023-02-13 20:03:55,851 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/.tmp/f2/d1343fc022f6446cac6153ac14c7e8cf 2023-02-13 20:03:55,859 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/.tmp/f2/eef2a80905524586be80a6e225a2a98c 2023-02-13 20:03:55,861 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/.tmp/f1/d801a66ba06f45a5ac7fbef69bf97237 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1/d801a66ba06f45a5ac7fbef69bf97237 2023-02-13 20:03:55,865 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/.tmp/f1/d6fbd7d7c99f41e6b4489bc643583a1e as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1/d6fbd7d7c99f41e6b4489bc643583a1e 2023-02-13 20:03:55,866 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1/d801a66ba06f45a5ac7fbef69bf97237, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:55,873 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/.tmp/f2/d1343fc022f6446cac6153ac14c7e8cf as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2/d1343fc022f6446cac6153ac14c7e8cf 2023-02-13 20:03:55,877 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/.tmp/f2/0948955c395246ef8a1be2f9b5434b7e 2023-02-13 20:03:55,880 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/.tmp/f2/6ba14a1bdba14580a230dafe4ac8f4d5 2023-02-13 20:03:55,881 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2/d1343fc022f6446cac6153ac14c7e8cf, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:55,882 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 33fc22da8f96cfa31d8d05d8eda1bd2d in 139ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:55,882 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-13 20:03:55,882 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 33fc22da8f96cfa31d8d05d8eda1bd2d: 2023-02-13 20:03:55,883 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,888 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:55,888 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1/d801a66ba06f45a5ac7fbef69bf97237] hfiles 2023-02-13 20:03:55,888 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1/d801a66ba06f45a5ac7fbef69bf97237 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,888 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2/d1343fc022f6446cac6153ac14c7e8cf] hfiles 2023-02-13 20:03:55,888 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2/d1343fc022f6446cac6153ac14c7e8cf for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,889 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1/d6fbd7d7c99f41e6b4489bc643583a1e, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 20:03:55,891 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/.tmp/f2/eef2a80905524586be80a6e225a2a98c as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2/eef2a80905524586be80a6e225a2a98c 2023-02-13 20:03:55,891 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/.tmp/f1/fefc705c2ce94398b30c69355af2e379 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1/fefc705c2ce94398b30c69355af2e379 2023-02-13 20:03:55,900 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/.tmp/f1/2922203fd92b43bd9b3ebb1a9b86b8bd as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1/2922203fd92b43bd9b3ebb1a9b86b8bd 2023-02-13 20:03:55,901 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1/fefc705c2ce94398b30c69355af2e379, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:55,901 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2/eef2a80905524586be80a6e225a2a98c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 20:03:55,903 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for aa573645573a18bc6f2a0e4754d288ac in 158ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:55,903 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/.tmp/f2/0948955c395246ef8a1be2f9b5434b7e as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2/0948955c395246ef8a1be2f9b5434b7e 2023-02-13 20:03:55,907 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2/0948955c395246ef8a1be2f9b5434b7e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:55,908 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 6d8af339b8196d932391d64edd665c96 in 166ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:55,911 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 6d8af339b8196d932391d64edd665c96: 2023-02-13 20:03:55,911 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for aa573645573a18bc6f2a0e4754d288ac: 2023-02-13 20:03:55,911 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,912 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,912 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:55,912 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:55,912 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1/fefc705c2ce94398b30c69355af2e379] hfiles 2023-02-13 20:03:55,912 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1/fefc705c2ce94398b30c69355af2e379 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,912 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1/d6fbd7d7c99f41e6b4489bc643583a1e] hfiles 2023-02-13 20:03:55,912 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2/0948955c395246ef8a1be2f9b5434b7e] hfiles 2023-02-13 20:03:55,912 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2/0948955c395246ef8a1be2f9b5434b7e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,912 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1/d6fbd7d7c99f41e6b4489bc643583a1e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,912 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2/eef2a80905524586be80a6e225a2a98c] hfiles 2023-02-13 20:03:55,912 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2/eef2a80905524586be80a6e225a2a98c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,915 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1/2922203fd92b43bd9b3ebb1a9b86b8bd, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:55,916 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/.tmp/f2/6ba14a1bdba14580a230dafe4ac8f4d5 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2/6ba14a1bdba14580a230dafe4ac8f4d5 2023-02-13 20:03:55,916 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/.tmp/f2/9755e63740664aa79e9b3e483f4c2b76 2023-02-13 20:03:55,925 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. completed. 2023-02-13 20:03:55,925 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:55,925 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:55,925 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 20:03:55,925 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. started... 2023-02-13 20:03:55,927 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 1f626f495a03c4e88c154830cde7650f 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 20:03:55,934 DEBUG [Listener at localhost/37999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:55,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 20:03:55,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:03:55,936 DEBUG [Listener at localhost/37999] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 20:03:55,936 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. completed. 2023-02-13 20:03:55,936 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:55,936 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:55,936 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 20:03:55,936 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. started... 2023-02-13 20:03:55,937 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2/6ba14a1bdba14580a230dafe4ac8f4d5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:55,938 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 30abf7b2bd989093bfa8f0915228b4af in 192ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:55,938 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 30abf7b2bd989093bfa8f0915228b4af: 2023-02-13 20:03:55,938 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,938 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:55,938 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1/2922203fd92b43bd9b3ebb1a9b86b8bd] hfiles 2023-02-13 20:03:55,938 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1/2922203fd92b43bd9b3ebb1a9b86b8bd for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,938 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2/6ba14a1bdba14580a230dafe4ac8f4d5] hfiles 2023-02-13 20:03:55,938 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2/6ba14a1bdba14580a230dafe4ac8f4d5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,941 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/.tmp/f1/dd5b0f7f9dab4e80b6cc40404e2d6141 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1/dd5b0f7f9dab4e80b6cc40404e2d6141 2023-02-13 20:03:55,945 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8927c608cb12d2eddba4aa6130140dfa: 2023-02-13 20:03:55,945 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. completed. 2023-02-13 20:03:55,945 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:55,945 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:55,946 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. started... 2023-02-13 20:03:55,945 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,947 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 05b94c5c2cb310d1dbc3f76b21d43ddd 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 20:03:55,946 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 20:03:55,949 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:55,949 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 20:03:55,949 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 20:03:55,952 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1/dd5b0f7f9dab4e80b6cc40404e2d6141, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:55,964 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/.tmp/f2/9755e63740664aa79e9b3e483f4c2b76 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2/9755e63740664aa79e9b3e483f4c2b76 2023-02-13 20:03:55,973 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2/9755e63740664aa79e9b3e483f4c2b76, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:55,974 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 41d40ad779288da6affe5207d3bf4cf7 in 230ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:55,974 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 41d40ad779288da6affe5207d3bf4cf7: 2023-02-13 20:03:55,974 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,974 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:55,974 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1/dd5b0f7f9dab4e80b6cc40404e2d6141] hfiles 2023-02-13 20:03:55,974 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1/dd5b0f7f9dab4e80b6cc40404e2d6141 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,974 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2/9755e63740664aa79e9b3e483f4c2b76] hfiles 2023-02-13 20:03:55,975 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2/9755e63740664aa79e9b3e483f4c2b76 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:55,984 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. completed. 2023-02-13 20:03:55,984 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:55,984 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 20:03:55,988 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/.tmp/f1/fb1f7060fb30452ba078716174ffa333 2023-02-13 20:03:55,999 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/.tmp/f1/f25678b0925849bba34fe479e3a2beb5 2023-02-13 20:03:56,000 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. completed. 2023-02-13 20:03:56,000 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:56,001 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 20:03:56,023 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/.tmp/f2/a9d65da9142840639c2e178c79d6f0fa 2023-02-13 20:03:56,026 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/.tmp/f2/17d6528c6ed64639a93eb1b27ca1b6d6 2023-02-13 20:03:56,031 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/.tmp/f1/fb1f7060fb30452ba078716174ffa333 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1/fb1f7060fb30452ba078716174ffa333 2023-02-13 20:03:56,033 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/.tmp/f1/f25678b0925849bba34fe479e3a2beb5 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1/f25678b0925849bba34fe479e3a2beb5 2023-02-13 20:03:56,036 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1/fb1f7060fb30452ba078716174ffa333, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:56,037 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/.tmp/f2/a9d65da9142840639c2e178c79d6f0fa as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2/a9d65da9142840639c2e178c79d6f0fa 2023-02-13 20:03:56,039 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1/f25678b0925849bba34fe479e3a2beb5, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 20:03:56,044 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/.tmp/f2/17d6528c6ed64639a93eb1b27ca1b6d6 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2/17d6528c6ed64639a93eb1b27ca1b6d6 2023-02-13 20:03:56,047 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2/a9d65da9142840639c2e178c79d6f0fa, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:56,048 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1f626f495a03c4e88c154830cde7650f in 121ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:56,048 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 1f626f495a03c4e88c154830cde7650f: 2023-02-13 20:03:56,049 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,049 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:56,049 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1/fb1f7060fb30452ba078716174ffa333] hfiles 2023-02-13 20:03:56,049 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1/fb1f7060fb30452ba078716174ffa333 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,049 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2/a9d65da9142840639c2e178c79d6f0fa] hfiles 2023-02-13 20:03:56,049 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2/a9d65da9142840639c2e178c79d6f0fa for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,050 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2/17d6528c6ed64639a93eb1b27ca1b6d6, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 20:03:56,051 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 05b94c5c2cb310d1dbc3f76b21d43ddd in 105ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:56,051 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 05b94c5c2cb310d1dbc3f76b21d43ddd: 2023-02-13 20:03:56,051 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,051 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:56,051 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1/f25678b0925849bba34fe479e3a2beb5] hfiles 2023-02-13 20:03:56,052 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1/f25678b0925849bba34fe479e3a2beb5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,052 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2/17d6528c6ed64639a93eb1b27ca1b6d6] hfiles 2023-02-13 20:03:56,052 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2/17d6528c6ed64639a93eb1b27ca1b6d6 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,063 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. completed. 2023-02-13 20:03:56,063 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:56,063 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 20:03:56,065 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. completed. 2023-02-13 20:03:56,065 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:56,065 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 20:03:56,065 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 20:03:56,065 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,065 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 20:03:56,065 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35987,1676318633072' in zk 2023-02-13 20:03:56,067 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,067 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 20:03:56,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,067 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:56,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:56,067 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 20:03:56,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:56,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:56,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35987,1676318633072': 2023-02-13 20:03:56,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35987,1676318633072' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 20:03:56,211 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/.tmp/f1/0c748b53a43b42dda44adb3e2cdd2414 2023-02-13 20:03:56,225 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/.tmp/f2/e0ce090ca39044468ada449f658db6f1 2023-02-13 20:03:56,229 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/.tmp/f1/0c748b53a43b42dda44adb3e2cdd2414 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1/0c748b53a43b42dda44adb3e2cdd2414 2023-02-13 20:03:56,232 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1/0c748b53a43b42dda44adb3e2cdd2414, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:56,233 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/.tmp/f2/e0ce090ca39044468ada449f658db6f1 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2/e0ce090ca39044468ada449f658db6f1 2023-02-13 20:03:56,236 DEBUG [Listener at localhost/37999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:56,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 20:03:56,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:03:56,237 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2/e0ce090ca39044468ada449f658db6f1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 20:03:56,237 DEBUG [Listener at localhost/37999] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 20:03:56,238 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8aae60631241dfab8a874b3907b9e7f5 in 469ms, sequenceid=5, compaction requested=false 2023-02-13 20:03:56,238 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 8aae60631241dfab8a874b3907b9e7f5: 2023-02-13 20:03:56,238 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,238 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:03:56,238 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1/0c748b53a43b42dda44adb3e2cdd2414] hfiles 2023-02-13 20:03:56,238 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1/0c748b53a43b42dda44adb3e2cdd2414 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,239 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2/e0ce090ca39044468ada449f658db6f1] hfiles 2023-02-13 20:03:56,239 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2/e0ce090ca39044468ada449f658db6f1 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,244 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. completed. 2023-02-13 20:03:56,244 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:56,244 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 20:03:56,406 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. completed. 2023-02-13 20:03:56,406 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:56,406 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 20:03:56,406 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 20:03:56,406 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,406 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 20:03:56,406 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35759,1676318633044' in zk 2023-02-13 20:03:56,408 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,408 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 20:03:56,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:56,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:56,408 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:56,408 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 20:03:56,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:56,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:56,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35759,1676318633044': 2023-02-13 20:03:56,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35759,1676318633044' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 20:03:56,411 INFO [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-13 20:03:56,411 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:03:56,411 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:03:56,411 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,411 INFO [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 20:03:56,412 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,413 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,413 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,413 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,413 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:03:56,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:56,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:56,413 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,414 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:56,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,415 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:56,415 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,421 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:56,421 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:03:56,421 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:56,421 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:56,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:56,421 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,421 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:03:56,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:03:56,422 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,421 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,422 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,421 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:56,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:56,422 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:56,422 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:03:56,422 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,422 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,422 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:03:56,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:03:56,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,482 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-13 20:03:56,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,482 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676318635628Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676318636422 (+794 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676318636422Writing data manifest for testWithMockedMapReduceMultiRegion at 1676318636433 (+11 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676318636448 (+15 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676318636482 (+34 ms) 2023-02-13 20:03:56,485 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 20:03:56,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 856 msec 2023-02-13 20:03:56,738 DEBUG [Listener at localhost/37999] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:03:56,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 20:03:56,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 20:03:56,739 INFO [Listener at localhost/37999] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 20:03:56,743 INFO [Listener at localhost/37999] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 20:03:56,749 INFO [Listener at localhost/37999] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 20:03:56,767 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35759] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:56,778 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35987] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:56,844 INFO [Listener at localhost/37999] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 20:03:56,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 20:03:56,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,851 INFO [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-13 20:03:56,851 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:03:56,852 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-13 20:03:56,852 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 20:03:56,853 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,853 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,854 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,854 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:56,854 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:56,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:56,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:56,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:56,854 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,854 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:56,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,855 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:56,855 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:03:56,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:03:56,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,855 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:03:56,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,855 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,856 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,856 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-13 20:03:56,856 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:03:56,856 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-13 20:03:56,857 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 20:03:56,857 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:03:56,857 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 20:03:56,857 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:56,857 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. started... 2023-02-13 20:03:56,857 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6d8af339b8196d932391d64edd665c96 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:56,859 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:56,860 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. started... 2023-02-13 20:03:56,860 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 20:03:56,860 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 41d40ad779288da6affe5207d3bf4cf7 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 20:03:56,860 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:56,860 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. started... 2023-02-13 20:03:56,860 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:56,861 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. started... 2023-02-13 20:03:56,861 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 33fc22da8f96cfa31d8d05d8eda1bd2d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:56,861 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 30abf7b2bd989093bfa8f0915228b4af 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:56,860 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 20:03:56,861 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 20:03:56,860 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:56,861 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. started... 2023-02-13 20:03:56,861 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. started... 2023-02-13 20:03:56,862 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8283b462cfc3827ec6600a627cdc3ea9: 2023-02-13 20:03:56,862 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing aa573645573a18bc6f2a0e4754d288ac 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 20:03:56,862 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:56,862 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:56,862 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 20:03:56,862 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. started... 2023-02-13 20:03:56,862 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8aae60631241dfab8a874b3907b9e7f5 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:56,884 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/.tmp/f1/fc2436639c2845d38d2d8368c859afd2 2023-02-13 20:03:56,892 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/.tmp/f1/ecc1d539f6c0473d989cae479bc6ce59 2023-02-13 20:03:56,892 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/.tmp/f1/894df0dfdd2d4613b48ee41af1eacab5 2023-02-13 20:03:56,903 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/.tmp/f1/e235cf35727a49f0ba0dfceca6d4d7a7 2023-02-13 20:03:56,905 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/.tmp/f1/520b237ae114447f9e2b97863c5d0cd5 2023-02-13 20:03:56,905 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/.tmp/f1/d6591f4c98a7495eabad151c7ff69126 2023-02-13 20:03:56,941 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/.tmp/f2/286317e7fbdb4d34b9037fda92af3672 2023-02-13 20:03:56,962 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/.tmp/f2/16f2e31f32a74be7ba13ed81f9032fa9 2023-02-13 20:03:56,965 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/.tmp/f2/5bc2eb380ca140368ae60ef1643c43e8 2023-02-13 20:03:56,967 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/.tmp/f2/c6048ee5a9da4d809a19e04b2b5e4218 2023-02-13 20:03:56,969 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/.tmp/f1/fc2436639c2845d38d2d8368c859afd2 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1/fc2436639c2845d38d2d8368c859afd2 2023-02-13 20:03:56,971 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/.tmp/f1/894df0dfdd2d4613b48ee41af1eacab5 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1/894df0dfdd2d4613b48ee41af1eacab5 2023-02-13 20:03:56,972 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/.tmp/f1/520b237ae114447f9e2b97863c5d0cd5 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1/520b237ae114447f9e2b97863c5d0cd5 2023-02-13 20:03:56,974 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/.tmp/f1/d6591f4c98a7495eabad151c7ff69126 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1/d6591f4c98a7495eabad151c7ff69126 2023-02-13 20:03:56,975 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1/fc2436639c2845d38d2d8368c859afd2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:56,976 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/.tmp/f2/8ea63079bce94a8ca57c052e85fc7c58 2023-02-13 20:03:56,977 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/.tmp/f2/286317e7fbdb4d34b9037fda92af3672 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2/286317e7fbdb4d34b9037fda92af3672 2023-02-13 20:03:56,977 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1/520b237ae114447f9e2b97863c5d0cd5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 20:03:56,977 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1/894df0dfdd2d4613b48ee41af1eacab5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:56,978 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/.tmp/f2/5bc2eb380ca140368ae60ef1643c43e8 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2/5bc2eb380ca140368ae60ef1643c43e8 2023-02-13 20:03:56,980 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/.tmp/f2/16f2e31f32a74be7ba13ed81f9032fa9 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2/16f2e31f32a74be7ba13ed81f9032fa9 2023-02-13 20:03:56,981 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1/d6591f4c98a7495eabad151c7ff69126, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:56,982 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/.tmp/f2/c6048ee5a9da4d809a19e04b2b5e4218 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2/c6048ee5a9da4d809a19e04b2b5e4218 2023-02-13 20:03:56,983 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/.tmp/f1/ecc1d539f6c0473d989cae479bc6ce59 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1/ecc1d539f6c0473d989cae479bc6ce59 2023-02-13 20:03:56,984 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2/286317e7fbdb4d34b9037fda92af3672, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:56,985 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 6d8af339b8196d932391d64edd665c96 in 128ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:56,985 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6d8af339b8196d932391d64edd665c96: 2023-02-13 20:03:56,985 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:56,985 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:56,985 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 20:03:56,985 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. started... 2023-02-13 20:03:56,985 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2/5bc2eb380ca140368ae60ef1643c43e8, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 20:03:56,985 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8927c608cb12d2eddba4aa6130140dfa: 2023-02-13 20:03:56,985 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:56,985 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 20:03:56,986 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for aa573645573a18bc6f2a0e4754d288ac in 125ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:56,986 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for aa573645573a18bc6f2a0e4754d288ac: 2023-02-13 20:03:56,986 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:56,986 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:56,986 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. started... 2023-02-13 20:03:56,986 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 20:03:56,986 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1f626f495a03c4e88c154830cde7650f 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 20:03:56,989 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2/16f2e31f32a74be7ba13ed81f9032fa9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:56,989 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2/c6048ee5a9da4d809a19e04b2b5e4218, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:56,990 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8aae60631241dfab8a874b3907b9e7f5 in 128ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:56,990 INFO [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 41d40ad779288da6affe5207d3bf4cf7 in 130ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:56,990 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 41d40ad779288da6affe5207d3bf4cf7: 2023-02-13 20:03:56,991 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1/ecc1d539f6c0473d989cae479bc6ce59, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:56,990 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8aae60631241dfab8a874b3907b9e7f5: 2023-02-13 20:03:56,991 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:56,991 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 20:03:56,991 DEBUG [rs(jenkins-hbase4.apache.org,35759,1676318633044)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:56,991 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 20:03:56,991 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 20:03:56,991 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,991 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/.tmp/f2/8ea63079bce94a8ca57c052e85fc7c58 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2/8ea63079bce94a8ca57c052e85fc7c58 2023-02-13 20:03:56,992 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 20:03:56,992 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35759,1676318633044' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 20:03:56,994 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:56,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:56,994 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:56,994 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,994 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:56,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:56,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:56,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:56,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:56,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35759,1676318633044' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 20:03:56,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26b798a5[Count = 1] remaining members to acquire global barrier 2023-02-13 20:03:56,998 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2/8ea63079bce94a8ca57c052e85fc7c58, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:56,999 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 30abf7b2bd989093bfa8f0915228b4af in 138ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:56,999 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 30abf7b2bd989093bfa8f0915228b4af: 2023-02-13 20:03:56,999 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:56,999 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:56,999 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 20:03:56,999 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. started... 2023-02-13 20:03:56,999 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 05b94c5c2cb310d1dbc3f76b21d43ddd 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 20:03:57,016 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/.tmp/f1/26d135cef99d4b48aab954eedb6dbc3a 2023-02-13 20:03:57,018 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/.tmp/f1/4f3040efe1f145fb9a1084f30f76b67b 2023-02-13 20:03:57,032 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/.tmp/f2/cfb9db51b8db4f1790b52b405b555412 2023-02-13 20:03:57,035 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/.tmp/f2/42066f2f339d457bb33e4b6159bb1967 2023-02-13 20:03:57,036 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/.tmp/f1/26d135cef99d4b48aab954eedb6dbc3a as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1/26d135cef99d4b48aab954eedb6dbc3a 2023-02-13 20:03:57,039 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/.tmp/f1/4f3040efe1f145fb9a1084f30f76b67b as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1/4f3040efe1f145fb9a1084f30f76b67b 2023-02-13 20:03:57,040 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1/26d135cef99d4b48aab954eedb6dbc3a, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:57,041 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/.tmp/f2/cfb9db51b8db4f1790b52b405b555412 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2/cfb9db51b8db4f1790b52b405b555412 2023-02-13 20:03:57,043 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1/4f3040efe1f145fb9a1084f30f76b67b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 20:03:57,044 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/.tmp/f2/42066f2f339d457bb33e4b6159bb1967 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2/42066f2f339d457bb33e4b6159bb1967 2023-02-13 20:03:57,045 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2/cfb9db51b8db4f1790b52b405b555412, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:57,046 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1f626f495a03c4e88c154830cde7650f in 60ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:57,046 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1f626f495a03c4e88c154830cde7650f: 2023-02-13 20:03:57,046 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:57,046 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 20:03:57,049 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2/42066f2f339d457bb33e4b6159bb1967, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 20:03:57,050 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 05b94c5c2cb310d1dbc3f76b21d43ddd in 51ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:57,050 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 05b94c5c2cb310d1dbc3f76b21d43ddd: 2023-02-13 20:03:57,050 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:57,050 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 20:03:57,366 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/.tmp/f2/b7136a6d996b4a2eb0d4a3152cd0a507 2023-02-13 20:03:57,371 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/.tmp/f1/e235cf35727a49f0ba0dfceca6d4d7a7 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1/e235cf35727a49f0ba0dfceca6d4d7a7 2023-02-13 20:03:57,375 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1/e235cf35727a49f0ba0dfceca6d4d7a7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:57,376 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/.tmp/f2/b7136a6d996b4a2eb0d4a3152cd0a507 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2/b7136a6d996b4a2eb0d4a3152cd0a507 2023-02-13 20:03:57,381 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2/b7136a6d996b4a2eb0d4a3152cd0a507, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 20:03:57,381 INFO [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 33fc22da8f96cfa31d8d05d8eda1bd2d in 520ms, sequenceid=9, compaction requested=false 2023-02-13 20:03:57,381 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 33fc22da8f96cfa31d8d05d8eda1bd2d: 2023-02-13 20:03:57,381 DEBUG [rs(jenkins-hbase4.apache.org,35987,1676318633072)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:57,382 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 20:03:57,382 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 20:03:57,382 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,382 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 20:03:57,382 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35987,1676318633072' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 20:03:57,383 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,383 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:57,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:57,384 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,384 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:03:57,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:57,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:57,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:57,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35987,1676318633072' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 20:03:57,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26b798a5[Count = 0] remaining members to acquire global barrier 2023-02-13 20:03:57,385 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 20:03:57,385 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,387 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,387 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,388 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,388 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 20:03:57,388 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 20:03:57,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,388 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35759,1676318633044' in zk 2023-02-13 20:03:57,388 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 20:03:57,388 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 20:03:57,388 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,35987,1676318633072' in zk 2023-02-13 20:03:57,388 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,388 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:03:57,389 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,389 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 20:03:57,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,389 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:57,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:57,389 DEBUG [member: 'jenkins-hbase4.apache.org,35759,1676318633044' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 20:03:57,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:57,390 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 20:03:57,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:57,390 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,390 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:57,390 DEBUG [member: 'jenkins-hbase4.apache.org,35987,1676318633072' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 20:03:57,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:57,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:57,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35759,1676318633044': 2023-02-13 20:03:57,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35759,1676318633044' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 20:03:57,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:57,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:57,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:57,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:57,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:57,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,35987,1676318633072': 2023-02-13 20:03:57,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35987,1676318633072' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 20:03:57,395 INFO [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-13 20:03:57,395 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:03:57,395 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:03:57,395 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,395 INFO [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 20:03:57,396 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,396 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,396 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,397 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:57,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,396 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:57,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:03:57,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:03:57,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:57,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:57,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:57,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:57,397 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:03:57,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,398 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:03:57,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,399 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:03:57,399 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,403 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,403 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,403 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:57,403 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:03:57,403 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,403 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:57,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:57,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:57,403 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:03:57,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:03:57,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:03:57,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-13 20:03:57,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 20:03:57,403 DEBUG [(jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:03:57,403 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:57,404 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:57,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:03:57,404 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:57,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:03:57,404 DEBUG [Listener at localhost/37999] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-13 20:03:57,404 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:57,404 DEBUG [Listener at localhost/37999] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 20:03:57,404 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,404 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,504 DEBUG [Listener at localhost/37999] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 20:03:57,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 20:03:57,510 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676318635613 type: FLUSH version: 2 ttl: 0 2023-02-13 20:03:57,511 DEBUG [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,511 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(239): region to add: 30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:57,511 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(239): region to add: 33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:57,511 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(239): region to add: aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:57,511 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(239): region to add: 6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:57,511 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(239): region to add: 1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:57,511 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(239): region to add: 41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:57,511 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(239): region to add: 05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:57,511 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(239): region to add: 8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:57,511 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(239): region to add: 8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:57,512 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(239): region to add: 8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:57,512 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(585): clone region=30abf7b2bd989093bfa8f0915228b4af as 30abf7b2bd989093bfa8f0915228b4af in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,512 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(585): clone region=33fc22da8f96cfa31d8d05d8eda1bd2d as 33fc22da8f96cfa31d8d05d8eda1bd2d in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,512 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(585): clone region=aa573645573a18bc6f2a0e4754d288ac as aa573645573a18bc6f2a0e4754d288ac in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,512 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(585): clone region=6d8af339b8196d932391d64edd665c96 as 6d8af339b8196d932391d64edd665c96 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,512 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(585): clone region=1f626f495a03c4e88c154830cde7650f as 1f626f495a03c4e88c154830cde7650f in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,512 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(585): clone region=41d40ad779288da6affe5207d3bf4cf7 as 41d40ad779288da6affe5207d3bf4cf7 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,512 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(585): clone region=05b94c5c2cb310d1dbc3f76b21d43ddd as 05b94c5c2cb310d1dbc3f76b21d43ddd in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,512 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(585): clone region=8283b462cfc3827ec6600a627cdc3ea9 as 8283b462cfc3827ec6600a627cdc3ea9 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,512 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(585): clone region=8927c608cb12d2eddba4aa6130140dfa as 8927c608cb12d2eddba4aa6130140dfa in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,512 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(585): clone region=8aae60631241dfab8a874b3907b9e7f5 as 8aae60631241dfab8a874b3907b9e7f5 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,514 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 30abf7b2bd989093bfa8f0915228b4af, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3 2023-02-13 20:03:57,514 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 41d40ad779288da6affe5207d3bf4cf7, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3 2023-02-13 20:03:57,514 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => aa573645573a18bc6f2a0e4754d288ac, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3 2023-02-13 20:03:57,515 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 33fc22da8f96cfa31d8d05d8eda1bd2d, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3 2023-02-13 20:03:57,515 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 6d8af339b8196d932391d64edd665c96, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3 2023-02-13 20:03:57,515 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 05b94c5c2cb310d1dbc3f76b21d43ddd, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3 2023-02-13 20:03:57,515 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 8283b462cfc3827ec6600a627cdc3ea9, NAME => 'testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3 2023-02-13 20:03:57,515 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 1f626f495a03c4e88c154830cde7650f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3 2023-02-13 20:03:57,534 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:57,534 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dd5b0f7f9dab4e80b6cc40404e2d6141 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,581 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9755e63740664aa79e9b3e483f4c2b76 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,584 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:57,584 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fb1f7060fb30452ba078716174ffa333 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,585 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:57,585 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d801a66ba06f45a5ac7fbef69bf97237 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,585 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:57,586 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fefc705c2ce94398b30c69355af2e379 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,587 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:57,587 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d6fbd7d7c99f41e6b4489bc643583a1e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,588 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:57,588 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 8283b462cfc3827ec6600a627cdc3ea9, disabling compactions & flushes 2023-02-13 20:03:57,588 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:57,588 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:57,588 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. after waiting 0 ms 2023-02-13 20:03:57,588 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:57,588 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:57,588 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 8283b462cfc3827ec6600a627cdc3ea9: Waiting for close lock at 1676318637588Disabling compacts and flushes for region at 1676318637588Disabling writes for close at 1676318637588Writing region close event to WAL at 1676318637588Closed at 1676318637588 2023-02-13 20:03:57,589 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 8927c608cb12d2eddba4aa6130140dfa, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3 2023-02-13 20:03:57,596 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:57,596 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 41d40ad779288da6affe5207d3bf4cf7, disabling compactions & flushes 2023-02-13 20:03:57,596 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 2922203fd92b43bd9b3ebb1a9b86b8bd from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,596 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:57,596 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:57,596 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. after waiting 0 ms 2023-02-13 20:03:57,596 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:57,596 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:57,596 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 41d40ad779288da6affe5207d3bf4cf7: Waiting for close lock at 1676318637596Disabling compacts and flushes for region at 1676318637596Disabling writes for close at 1676318637596Writing region close event to WAL at 1676318637596Closed at 1676318637596 2023-02-13 20:03:57,597 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d1343fc022f6446cac6153ac14c7e8cf from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,597 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a9d65da9142840639c2e178c79d6f0fa from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,597 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 8aae60631241dfab8a874b3907b9e7f5, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3 2023-02-13 20:03:57,597 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0948955c395246ef8a1be2f9b5434b7e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,604 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink eef2a80905524586be80a6e225a2a98c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,610 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 1f626f495a03c4e88c154830cde7650f, disabling compactions & flushes 2023-02-13 20:03:57,610 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 6d8af339b8196d932391d64edd665c96, disabling compactions & flushes 2023-02-13 20:03:57,610 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:57,610 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:57,610 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:57,610 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:57,611 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. after waiting 0 ms 2023-02-13 20:03:57,611 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. after waiting 0 ms 2023-02-13 20:03:57,611 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:57,611 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:57,611 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:57,611 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 6d8af339b8196d932391d64edd665c96: Waiting for close lock at 1676318637610Disabling compacts and flushes for region at 1676318637610Disabling writes for close at 1676318637611 (+1 ms)Writing region close event to WAL at 1676318637611Closed at 1676318637611 2023-02-13 20:03:57,611 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:57,611 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 1f626f495a03c4e88c154830cde7650f: Waiting for close lock at 1676318637610Disabling compacts and flushes for region at 1676318637610Disabling writes for close at 1676318637611 (+1 ms)Writing region close event to WAL at 1676318637611Closed at 1676318637611 2023-02-13 20:03:57,612 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6ba14a1bdba14580a230dafe4ac8f4d5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,612 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 33fc22da8f96cfa31d8d05d8eda1bd2d, disabling compactions & flushes 2023-02-13 20:03:57,612 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:57,612 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:57,612 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. after waiting 0 ms 2023-02-13 20:03:57,613 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:57,613 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:57,613 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 33fc22da8f96cfa31d8d05d8eda1bd2d: Waiting for close lock at 1676318637612Disabling compacts and flushes for region at 1676318637612Disabling writes for close at 1676318637613 (+1 ms)Writing region close event to WAL at 1676318637613Closed at 1676318637613 2023-02-13 20:03:57,616 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing aa573645573a18bc6f2a0e4754d288ac, disabling compactions & flushes 2023-02-13 20:03:57,616 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:57,616 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:57,616 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. after waiting 0 ms 2023-02-13 20:03:57,616 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:57,616 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:57,616 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for aa573645573a18bc6f2a0e4754d288ac: Waiting for close lock at 1676318637616Disabling compacts and flushes for region at 1676318637616Disabling writes for close at 1676318637616Writing region close event to WAL at 1676318637616Closed at 1676318637616 2023-02-13 20:03:57,616 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 30abf7b2bd989093bfa8f0915228b4af, disabling compactions & flushes 2023-02-13 20:03:57,616 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:57,616 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:57,616 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. after waiting 0 ms 2023-02-13 20:03:57,616 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:57,616 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:57,616 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 30abf7b2bd989093bfa8f0915228b4af: Waiting for close lock at 1676318637616Disabling compacts and flushes for region at 1676318637616Disabling writes for close at 1676318637616Writing region close event to WAL at 1676318637616Closed at 1676318637616 2023-02-13 20:03:57,622 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:57,623 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 8927c608cb12d2eddba4aa6130140dfa, disabling compactions & flushes 2023-02-13 20:03:57,623 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:57,623 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:57,623 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. after waiting 0 ms 2023-02-13 20:03:57,623 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:57,623 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:57,623 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 8927c608cb12d2eddba4aa6130140dfa: Waiting for close lock at 1676318637623Disabling compacts and flushes for region at 1676318637623Disabling writes for close at 1676318637623Writing region close event to WAL at 1676318637623Closed at 1676318637623 2023-02-13 20:03:57,989 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:57,989 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f25678b0925849bba34fe479e3a2beb5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,991 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 17d6528c6ed64639a93eb1b27ca1b6d6 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:57,993 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 05b94c5c2cb310d1dbc3f76b21d43ddd, disabling compactions & flushes 2023-02-13 20:03:57,993 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:57,993 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:57,993 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. after waiting 0 ms 2023-02-13 20:03:57,993 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:57,993 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:57,993 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 05b94c5c2cb310d1dbc3f76b21d43ddd: Waiting for close lock at 1676318637993Disabling compacts and flushes for region at 1676318637993Disabling writes for close at 1676318637993Writing region close event to WAL at 1676318637993Closed at 1676318637993 2023-02-13 20:03:58,023 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:58,023 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0c748b53a43b42dda44adb3e2cdd2414 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:58,026 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e0ce090ca39044468ada449f658db6f1 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:58,028 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 8aae60631241dfab8a874b3907b9e7f5, disabling compactions & flushes 2023-02-13 20:03:58,029 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:58,029 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:58,029 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. after waiting 0 ms 2023-02-13 20:03:58,029 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:58,029 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:58,029 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 8aae60631241dfab8a874b3907b9e7f5: Waiting for close lock at 1676318638028Disabling compacts and flushes for region at 1676318638028Disabling writes for close at 1676318638029 (+1 ms)Writing region close event to WAL at 1676318638029Closed at 1676318638029 2023-02-13 20:03:58,029 INFO [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676318635613 type: FLUSH version: 2 ttl: 0 2023-02-13 20:03:58,029 DEBUG [Listener at localhost/37999] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3 2023-02-13 20:03:58,029 DEBUG [Listener at localhost/37999] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3 2023-02-13 20:03:58,030 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-data/ 2023-02-13 20:03:58,031 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |----default/ 2023-02-13 20:03:58,031 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-13 20:03:58,032 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |----------05b94c5c2cb310d1dbc3f76b21d43ddd/ 2023-02-13 20:03:58,032 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:58,032 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:58,032 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=05b94c5c2cb310d1dbc3f76b21d43ddd-f25678b0925849bba34fe479e3a2beb5 2023-02-13 20:03:58,032 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:58,033 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=05b94c5c2cb310d1dbc3f76b21d43ddd-17d6528c6ed64639a93eb1b27ca1b6d6 2023-02-13 20:03:58,033 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |----------1f626f495a03c4e88c154830cde7650f/ 2023-02-13 20:03:58,033 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:58,033 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:58,034 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1f626f495a03c4e88c154830cde7650f-fb1f7060fb30452ba078716174ffa333 2023-02-13 20:03:58,034 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:58,034 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1f626f495a03c4e88c154830cde7650f-a9d65da9142840639c2e178c79d6f0fa 2023-02-13 20:03:58,034 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |----------30abf7b2bd989093bfa8f0915228b4af/ 2023-02-13 20:03:58,034 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:58,034 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:58,035 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=30abf7b2bd989093bfa8f0915228b4af-2922203fd92b43bd9b3ebb1a9b86b8bd 2023-02-13 20:03:58,035 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:58,035 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=30abf7b2bd989093bfa8f0915228b4af-6ba14a1bdba14580a230dafe4ac8f4d5 2023-02-13 20:03:58,035 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |----------33fc22da8f96cfa31d8d05d8eda1bd2d/ 2023-02-13 20:03:58,035 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:58,035 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:58,036 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=33fc22da8f96cfa31d8d05d8eda1bd2d-d801a66ba06f45a5ac7fbef69bf97237 2023-02-13 20:03:58,036 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:58,036 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=33fc22da8f96cfa31d8d05d8eda1bd2d-d1343fc022f6446cac6153ac14c7e8cf 2023-02-13 20:03:58,036 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |----------41d40ad779288da6affe5207d3bf4cf7/ 2023-02-13 20:03:58,037 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:58,037 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:58,037 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=41d40ad779288da6affe5207d3bf4cf7-dd5b0f7f9dab4e80b6cc40404e2d6141 2023-02-13 20:03:58,037 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:58,037 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=41d40ad779288da6affe5207d3bf4cf7-9755e63740664aa79e9b3e483f4c2b76 2023-02-13 20:03:58,037 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |----------6d8af339b8196d932391d64edd665c96/ 2023-02-13 20:03:58,038 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:58,038 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:58,038 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6d8af339b8196d932391d64edd665c96-fefc705c2ce94398b30c69355af2e379 2023-02-13 20:03:58,038 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:58,038 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=6d8af339b8196d932391d64edd665c96-0948955c395246ef8a1be2f9b5434b7e 2023-02-13 20:03:58,038 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |----------8283b462cfc3827ec6600a627cdc3ea9/ 2023-02-13 20:03:58,039 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:58,039 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |----------8927c608cb12d2eddba4aa6130140dfa/ 2023-02-13 20:03:58,039 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:58,039 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |----------8aae60631241dfab8a874b3907b9e7f5/ 2023-02-13 20:03:58,039 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:58,039 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:58,040 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8aae60631241dfab8a874b3907b9e7f5-0c748b53a43b42dda44adb3e2cdd2414 2023-02-13 20:03:58,040 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:58,040 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8aae60631241dfab8a874b3907b9e7f5-e0ce090ca39044468ada449f658db6f1 2023-02-13 20:03:58,040 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |----------aa573645573a18bc6f2a0e4754d288ac/ 2023-02-13 20:03:58,040 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:03:58,041 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:03:58,041 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=aa573645573a18bc6f2a0e4754d288ac-d6fbd7d7c99f41e6b4489bc643583a1e 2023-02-13 20:03:58,041 DEBUG [Listener at localhost/37999] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:03:58,041 DEBUG [Listener at localhost/37999] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=aa573645573a18bc6f2a0e4754d288ac-eef2a80905524586be80a6e225a2a98c 2023-02-13 20:03:58,044 INFO [Listener at localhost/37999] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 20:03:58,608 DEBUG [Listener at localhost/37999] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:58,608 INFO [Listener at localhost/37999] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:58,610 DEBUG [Listener at localhost/37999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:58,612 INFO [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:58,613 DEBUG [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1 2023-02-13 20:03:58,613 INFO [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41d40ad779288da6affe5207d3bf4cf7 columnFamilyName f1 2023-02-13 20:03:58,617 DEBUG [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1/testWithMockedMapReduceMultiRegion=41d40ad779288da6affe5207d3bf4cf7-dd5b0f7f9dab4e80b6cc40404e2d6141 2023-02-13 20:03:58,618 INFO [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] regionserver.HStore(310): Store=41d40ad779288da6affe5207d3bf4cf7/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,618 INFO [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:58,618 DEBUG [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2 2023-02-13 20:03:58,619 INFO [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41d40ad779288da6affe5207d3bf4cf7 columnFamilyName f2 2023-02-13 20:03:58,622 DEBUG [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2/testWithMockedMapReduceMultiRegion=41d40ad779288da6affe5207d3bf4cf7-9755e63740664aa79e9b3e483f4c2b76 2023-02-13 20:03:58,622 INFO [StoreOpener-41d40ad779288da6affe5207d3bf4cf7-1] regionserver.HStore(310): Store=41d40ad779288da6affe5207d3bf4cf7/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,623 DEBUG [Listener at localhost/37999] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:58,623 INFO [Listener at localhost/37999] regionserver.HRegion(1071): Opened 41d40ad779288da6affe5207d3bf4cf7; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62238263, jitterRate=-0.07257761061191559}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:58,623 DEBUG [Listener at localhost/37999] regionserver.HRegion(964): Region open journal for 41d40ad779288da6affe5207d3bf4cf7: Writing region info on filesystem at 1676318638610Initializing all the Stores at 1676318638611 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638611Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638611Region opened successfully at 1676318638623 (+12 ms) 2023-02-13 20:03:58,631 DEBUG [Listener at localhost/37999] regionserver.HRegion(1603): Closing 41d40ad779288da6affe5207d3bf4cf7, disabling compactions & flushes 2023-02-13 20:03:58,631 INFO [Listener at localhost/37999] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:58,631 DEBUG [Listener at localhost/37999] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:58,631 DEBUG [Listener at localhost/37999] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. after waiting 0 ms 2023-02-13 20:03:58,631 DEBUG [Listener at localhost/37999] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:58,632 INFO [Listener at localhost/37999] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:58,632 DEBUG [Listener at localhost/37999] regionserver.HRegion(1557): Region close journal for 41d40ad779288da6affe5207d3bf4cf7: Waiting for close lock at 1676318638631Disabling compacts and flushes for region at 1676318638631Disabling writes for close at 1676318638631Writing region close event to WAL at 1676318638632 (+1 ms)Closed at 1676318638632 2023-02-13 20:03:58,633 DEBUG [Listener at localhost/37999] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:58,633 INFO [Listener at localhost/37999] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:58,635 DEBUG [Listener at localhost/37999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:58,637 INFO [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:58,638 DEBUG [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9/f1 2023-02-13 20:03:58,638 INFO [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8283b462cfc3827ec6600a627cdc3ea9 columnFamilyName f1 2023-02-13 20:03:58,639 INFO [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] regionserver.HStore(310): Store=8283b462cfc3827ec6600a627cdc3ea9/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,639 INFO [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:58,640 DEBUG [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9/f2 2023-02-13 20:03:58,640 INFO [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8283b462cfc3827ec6600a627cdc3ea9 columnFamilyName f2 2023-02-13 20:03:58,641 INFO [StoreOpener-8283b462cfc3827ec6600a627cdc3ea9-1] regionserver.HStore(310): Store=8283b462cfc3827ec6600a627cdc3ea9/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,641 DEBUG [Listener at localhost/37999] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:58,641 INFO [Listener at localhost/37999] regionserver.HRegion(1071): Opened 8283b462cfc3827ec6600a627cdc3ea9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60955902, jitterRate=-0.09168627858161926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:58,641 DEBUG [Listener at localhost/37999] regionserver.HRegion(964): Region open journal for 8283b462cfc3827ec6600a627cdc3ea9: Writing region info on filesystem at 1676318638635Initializing all the Stores at 1676318638636 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638636Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638636Region opened successfully at 1676318638641 (+5 ms) 2023-02-13 20:03:58,641 DEBUG [Listener at localhost/37999] regionserver.HRegion(1603): Closing 8283b462cfc3827ec6600a627cdc3ea9, disabling compactions & flushes 2023-02-13 20:03:58,641 INFO [Listener at localhost/37999] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:58,641 DEBUG [Listener at localhost/37999] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:58,642 DEBUG [Listener at localhost/37999] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. after waiting 0 ms 2023-02-13 20:03:58,642 DEBUG [Listener at localhost/37999] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:58,642 INFO [Listener at localhost/37999] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:58,642 DEBUG [Listener at localhost/37999] regionserver.HRegion(1557): Region close journal for 8283b462cfc3827ec6600a627cdc3ea9: Waiting for close lock at 1676318638641Disabling compacts and flushes for region at 1676318638641Disabling writes for close at 1676318638642 (+1 ms)Writing region close event to WAL at 1676318638642Closed at 1676318638642 2023-02-13 20:03:58,642 DEBUG [Listener at localhost/37999] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:58,642 INFO [Listener at localhost/37999] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:58,646 DEBUG [Listener at localhost/37999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:58,648 INFO [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:58,649 DEBUG [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa/f1 2023-02-13 20:03:58,649 INFO [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8927c608cb12d2eddba4aa6130140dfa columnFamilyName f1 2023-02-13 20:03:58,649 INFO [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] regionserver.HStore(310): Store=8927c608cb12d2eddba4aa6130140dfa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,649 INFO [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:58,650 DEBUG [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa/f2 2023-02-13 20:03:58,650 INFO [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8927c608cb12d2eddba4aa6130140dfa columnFamilyName f2 2023-02-13 20:03:58,651 INFO [StoreOpener-8927c608cb12d2eddba4aa6130140dfa-1] regionserver.HStore(310): Store=8927c608cb12d2eddba4aa6130140dfa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,651 DEBUG [Listener at localhost/37999] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:58,651 INFO [Listener at localhost/37999] regionserver.HRegion(1071): Opened 8927c608cb12d2eddba4aa6130140dfa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70665228, jitterRate=0.052993953227996826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:58,651 DEBUG [Listener at localhost/37999] regionserver.HRegion(964): Region open journal for 8927c608cb12d2eddba4aa6130140dfa: Writing region info on filesystem at 1676318638646Initializing all the Stores at 1676318638647 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638647Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638647Region opened successfully at 1676318638651 (+4 ms) 2023-02-13 20:03:58,651 DEBUG [Listener at localhost/37999] regionserver.HRegion(1603): Closing 8927c608cb12d2eddba4aa6130140dfa, disabling compactions & flushes 2023-02-13 20:03:58,651 INFO [Listener at localhost/37999] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:58,652 DEBUG [Listener at localhost/37999] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:58,652 DEBUG [Listener at localhost/37999] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. after waiting 0 ms 2023-02-13 20:03:58,652 DEBUG [Listener at localhost/37999] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:58,652 INFO [Listener at localhost/37999] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:58,652 DEBUG [Listener at localhost/37999] regionserver.HRegion(1557): Region close journal for 8927c608cb12d2eddba4aa6130140dfa: Waiting for close lock at 1676318638651Disabling compacts and flushes for region at 1676318638651Disabling writes for close at 1676318638652 (+1 ms)Writing region close event to WAL at 1676318638652Closed at 1676318638652 2023-02-13 20:03:58,652 DEBUG [Listener at localhost/37999] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:58,653 INFO [Listener at localhost/37999] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:58,654 DEBUG [Listener at localhost/37999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:58,656 INFO [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:58,656 DEBUG [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1 2023-02-13 20:03:58,657 INFO [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05b94c5c2cb310d1dbc3f76b21d43ddd columnFamilyName f1 2023-02-13 20:03:58,664 DEBUG [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1/testWithMockedMapReduceMultiRegion=05b94c5c2cb310d1dbc3f76b21d43ddd-f25678b0925849bba34fe479e3a2beb5 2023-02-13 20:03:58,664 INFO [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] regionserver.HStore(310): Store=05b94c5c2cb310d1dbc3f76b21d43ddd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,664 INFO [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:58,665 DEBUG [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2 2023-02-13 20:03:58,665 INFO [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05b94c5c2cb310d1dbc3f76b21d43ddd columnFamilyName f2 2023-02-13 20:03:58,669 DEBUG [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2/testWithMockedMapReduceMultiRegion=05b94c5c2cb310d1dbc3f76b21d43ddd-17d6528c6ed64639a93eb1b27ca1b6d6 2023-02-13 20:03:58,669 INFO [StoreOpener-05b94c5c2cb310d1dbc3f76b21d43ddd-1] regionserver.HStore(310): Store=05b94c5c2cb310d1dbc3f76b21d43ddd/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,669 DEBUG [Listener at localhost/37999] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:58,669 INFO [Listener at localhost/37999] regionserver.HRegion(1071): Opened 05b94c5c2cb310d1dbc3f76b21d43ddd; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59665228, jitterRate=-0.11091881990432739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:58,669 DEBUG [Listener at localhost/37999] regionserver.HRegion(964): Region open journal for 05b94c5c2cb310d1dbc3f76b21d43ddd: Writing region info on filesystem at 1676318638654Initializing all the Stores at 1676318638655 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638655Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638655Region opened successfully at 1676318638669 (+14 ms) 2023-02-13 20:03:58,679 DEBUG [Listener at localhost/37999] regionserver.HRegion(1603): Closing 05b94c5c2cb310d1dbc3f76b21d43ddd, disabling compactions & flushes 2023-02-13 20:03:58,679 INFO [Listener at localhost/37999] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:58,679 DEBUG [Listener at localhost/37999] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:58,680 DEBUG [Listener at localhost/37999] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. after waiting 0 ms 2023-02-13 20:03:58,680 DEBUG [Listener at localhost/37999] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:58,680 INFO [Listener at localhost/37999] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:58,680 DEBUG [Listener at localhost/37999] regionserver.HRegion(1557): Region close journal for 05b94c5c2cb310d1dbc3f76b21d43ddd: Waiting for close lock at 1676318638679Disabling compacts and flushes for region at 1676318638679Disabling writes for close at 1676318638680 (+1 ms)Writing region close event to WAL at 1676318638680Closed at 1676318638680 2023-02-13 20:03:58,681 DEBUG [Listener at localhost/37999] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:58,681 INFO [Listener at localhost/37999] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:58,683 DEBUG [Listener at localhost/37999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:58,685 INFO [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:58,685 DEBUG [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1 2023-02-13 20:03:58,686 INFO [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30abf7b2bd989093bfa8f0915228b4af columnFamilyName f1 2023-02-13 20:03:58,690 DEBUG [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1/testWithMockedMapReduceMultiRegion=30abf7b2bd989093bfa8f0915228b4af-2922203fd92b43bd9b3ebb1a9b86b8bd 2023-02-13 20:03:58,690 INFO [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] regionserver.HStore(310): Store=30abf7b2bd989093bfa8f0915228b4af/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,690 INFO [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:58,691 DEBUG [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2 2023-02-13 20:03:58,691 INFO [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30abf7b2bd989093bfa8f0915228b4af columnFamilyName f2 2023-02-13 20:03:58,694 DEBUG [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2/testWithMockedMapReduceMultiRegion=30abf7b2bd989093bfa8f0915228b4af-6ba14a1bdba14580a230dafe4ac8f4d5 2023-02-13 20:03:58,694 INFO [StoreOpener-30abf7b2bd989093bfa8f0915228b4af-1] regionserver.HStore(310): Store=30abf7b2bd989093bfa8f0915228b4af/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,695 DEBUG [Listener at localhost/37999] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:58,695 INFO [Listener at localhost/37999] regionserver.HRegion(1071): Opened 30abf7b2bd989093bfa8f0915228b4af; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64271785, jitterRate=-0.042275771498680115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:58,695 DEBUG [Listener at localhost/37999] regionserver.HRegion(964): Region open journal for 30abf7b2bd989093bfa8f0915228b4af: Writing region info on filesystem at 1676318638683Initializing all the Stores at 1676318638683Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638683Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638683Region opened successfully at 1676318638695 (+12 ms) 2023-02-13 20:03:58,703 DEBUG [Listener at localhost/37999] regionserver.HRegion(1603): Closing 30abf7b2bd989093bfa8f0915228b4af, disabling compactions & flushes 2023-02-13 20:03:58,704 INFO [Listener at localhost/37999] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:58,704 DEBUG [Listener at localhost/37999] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:58,704 DEBUG [Listener at localhost/37999] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. after waiting 0 ms 2023-02-13 20:03:58,704 DEBUG [Listener at localhost/37999] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:58,705 INFO [Listener at localhost/37999] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:58,705 DEBUG [Listener at localhost/37999] regionserver.HRegion(1557): Region close journal for 30abf7b2bd989093bfa8f0915228b4af: Waiting for close lock at 1676318638703Disabling compacts and flushes for region at 1676318638703Disabling writes for close at 1676318638704 (+1 ms)Writing region close event to WAL at 1676318638705 (+1 ms)Closed at 1676318638705 2023-02-13 20:03:58,705 DEBUG [Listener at localhost/37999] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:58,706 INFO [Listener at localhost/37999] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:58,707 DEBUG [Listener at localhost/37999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:58,709 INFO [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:58,709 DEBUG [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1 2023-02-13 20:03:58,710 INFO [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f626f495a03c4e88c154830cde7650f columnFamilyName f1 2023-02-13 20:03:58,714 DEBUG [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1/testWithMockedMapReduceMultiRegion=1f626f495a03c4e88c154830cde7650f-fb1f7060fb30452ba078716174ffa333 2023-02-13 20:03:58,715 INFO [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] regionserver.HStore(310): Store=1f626f495a03c4e88c154830cde7650f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,715 INFO [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:58,716 DEBUG [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2 2023-02-13 20:03:58,716 INFO [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1f626f495a03c4e88c154830cde7650f columnFamilyName f2 2023-02-13 20:03:58,720 DEBUG [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2/testWithMockedMapReduceMultiRegion=1f626f495a03c4e88c154830cde7650f-a9d65da9142840639c2e178c79d6f0fa 2023-02-13 20:03:58,720 INFO [StoreOpener-1f626f495a03c4e88c154830cde7650f-1] regionserver.HStore(310): Store=1f626f495a03c4e88c154830cde7650f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,720 DEBUG [Listener at localhost/37999] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:58,720 INFO [Listener at localhost/37999] regionserver.HRegion(1071): Opened 1f626f495a03c4e88c154830cde7650f; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71116644, jitterRate=0.05972057580947876}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:58,721 DEBUG [Listener at localhost/37999] regionserver.HRegion(964): Region open journal for 1f626f495a03c4e88c154830cde7650f: Writing region info on filesystem at 1676318638707Initializing all the Stores at 1676318638707Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638708 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638708Region opened successfully at 1676318638720 (+12 ms) 2023-02-13 20:03:58,729 DEBUG [Listener at localhost/37999] regionserver.HRegion(1603): Closing 1f626f495a03c4e88c154830cde7650f, disabling compactions & flushes 2023-02-13 20:03:58,730 INFO [Listener at localhost/37999] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:58,730 DEBUG [Listener at localhost/37999] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:58,730 DEBUG [Listener at localhost/37999] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. after waiting 0 ms 2023-02-13 20:03:58,730 DEBUG [Listener at localhost/37999] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:58,732 INFO [Listener at localhost/37999] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:58,732 DEBUG [Listener at localhost/37999] regionserver.HRegion(1557): Region close journal for 1f626f495a03c4e88c154830cde7650f: Waiting for close lock at 1676318638729Disabling compacts and flushes for region at 1676318638729Disabling writes for close at 1676318638730 (+1 ms)Writing region close event to WAL at 1676318638732 (+2 ms)Closed at 1676318638732 2023-02-13 20:03:58,733 DEBUG [Listener at localhost/37999] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:58,733 INFO [Listener at localhost/37999] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:58,734 DEBUG [Listener at localhost/37999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:58,736 INFO [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:58,737 DEBUG [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1 2023-02-13 20:03:58,737 INFO [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33fc22da8f96cfa31d8d05d8eda1bd2d columnFamilyName f1 2023-02-13 20:03:58,741 DEBUG [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1/testWithMockedMapReduceMultiRegion=33fc22da8f96cfa31d8d05d8eda1bd2d-d801a66ba06f45a5ac7fbef69bf97237 2023-02-13 20:03:58,741 INFO [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] regionserver.HStore(310): Store=33fc22da8f96cfa31d8d05d8eda1bd2d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,741 INFO [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:58,742 DEBUG [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2 2023-02-13 20:03:58,742 INFO [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33fc22da8f96cfa31d8d05d8eda1bd2d columnFamilyName f2 2023-02-13 20:03:58,746 DEBUG [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2/testWithMockedMapReduceMultiRegion=33fc22da8f96cfa31d8d05d8eda1bd2d-d1343fc022f6446cac6153ac14c7e8cf 2023-02-13 20:03:58,746 INFO [StoreOpener-33fc22da8f96cfa31d8d05d8eda1bd2d-1] regionserver.HStore(310): Store=33fc22da8f96cfa31d8d05d8eda1bd2d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,746 DEBUG [Listener at localhost/37999] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:58,746 INFO [Listener at localhost/37999] regionserver.HRegion(1071): Opened 33fc22da8f96cfa31d8d05d8eda1bd2d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68229491, jitterRate=0.016698643565177917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:58,747 DEBUG [Listener at localhost/37999] regionserver.HRegion(964): Region open journal for 33fc22da8f96cfa31d8d05d8eda1bd2d: Writing region info on filesystem at 1676318638734Initializing all the Stores at 1676318638735 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638735Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638735Region opened successfully at 1676318638746 (+11 ms) 2023-02-13 20:03:58,754 DEBUG [Listener at localhost/37999] regionserver.HRegion(1603): Closing 33fc22da8f96cfa31d8d05d8eda1bd2d, disabling compactions & flushes 2023-02-13 20:03:58,754 INFO [Listener at localhost/37999] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:58,754 DEBUG [Listener at localhost/37999] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:58,754 DEBUG [Listener at localhost/37999] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. after waiting 0 ms 2023-02-13 20:03:58,754 DEBUG [Listener at localhost/37999] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:58,755 INFO [Listener at localhost/37999] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:58,755 DEBUG [Listener at localhost/37999] regionserver.HRegion(1557): Region close journal for 33fc22da8f96cfa31d8d05d8eda1bd2d: Waiting for close lock at 1676318638754Disabling compacts and flushes for region at 1676318638754Disabling writes for close at 1676318638754Writing region close event to WAL at 1676318638755 (+1 ms)Closed at 1676318638755 2023-02-13 20:03:58,756 DEBUG [Listener at localhost/37999] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:58,756 INFO [Listener at localhost/37999] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:58,760 DEBUG [Listener at localhost/37999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:58,762 INFO [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:58,762 DEBUG [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1 2023-02-13 20:03:58,763 INFO [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8aae60631241dfab8a874b3907b9e7f5 columnFamilyName f1 2023-02-13 20:03:58,767 DEBUG [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1/testWithMockedMapReduceMultiRegion=8aae60631241dfab8a874b3907b9e7f5-0c748b53a43b42dda44adb3e2cdd2414 2023-02-13 20:03:58,767 INFO [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] regionserver.HStore(310): Store=8aae60631241dfab8a874b3907b9e7f5/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,767 INFO [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:58,768 DEBUG [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2 2023-02-13 20:03:58,768 INFO [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8aae60631241dfab8a874b3907b9e7f5 columnFamilyName f2 2023-02-13 20:03:58,772 DEBUG [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2/testWithMockedMapReduceMultiRegion=8aae60631241dfab8a874b3907b9e7f5-e0ce090ca39044468ada449f658db6f1 2023-02-13 20:03:58,772 INFO [StoreOpener-8aae60631241dfab8a874b3907b9e7f5-1] regionserver.HStore(310): Store=8aae60631241dfab8a874b3907b9e7f5/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,772 DEBUG [Listener at localhost/37999] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:58,772 INFO [Listener at localhost/37999] regionserver.HRegion(1071): Opened 8aae60631241dfab8a874b3907b9e7f5; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68256264, jitterRate=0.0170975923538208}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:58,773 DEBUG [Listener at localhost/37999] regionserver.HRegion(964): Region open journal for 8aae60631241dfab8a874b3907b9e7f5: Writing region info on filesystem at 1676318638760Initializing all the Stores at 1676318638761 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638761Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638761Region opened successfully at 1676318638772 (+11 ms) 2023-02-13 20:03:58,780 DEBUG [Listener at localhost/37999] regionserver.HRegion(1603): Closing 8aae60631241dfab8a874b3907b9e7f5, disabling compactions & flushes 2023-02-13 20:03:58,780 INFO [Listener at localhost/37999] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:58,780 DEBUG [Listener at localhost/37999] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:58,781 DEBUG [Listener at localhost/37999] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. after waiting 1 ms 2023-02-13 20:03:58,781 DEBUG [Listener at localhost/37999] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:58,781 INFO [Listener at localhost/37999] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:58,781 DEBUG [Listener at localhost/37999] regionserver.HRegion(1557): Region close journal for 8aae60631241dfab8a874b3907b9e7f5: Waiting for close lock at 1676318638780Disabling compacts and flushes for region at 1676318638780Disabling writes for close at 1676318638781 (+1 ms)Writing region close event to WAL at 1676318638781Closed at 1676318638781 2023-02-13 20:03:58,782 DEBUG [Listener at localhost/37999] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:58,782 INFO [Listener at localhost/37999] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:58,783 DEBUG [Listener at localhost/37999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:58,789 INFO [StoreOpener-6d8af339b8196d932391d64edd665c96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:58,790 DEBUG [StoreOpener-6d8af339b8196d932391d64edd665c96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1 2023-02-13 20:03:58,790 INFO [StoreOpener-6d8af339b8196d932391d64edd665c96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d8af339b8196d932391d64edd665c96 columnFamilyName f1 2023-02-13 20:03:58,797 DEBUG [StoreOpener-6d8af339b8196d932391d64edd665c96-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1/testWithMockedMapReduceMultiRegion=6d8af339b8196d932391d64edd665c96-fefc705c2ce94398b30c69355af2e379 2023-02-13 20:03:58,797 INFO [StoreOpener-6d8af339b8196d932391d64edd665c96-1] regionserver.HStore(310): Store=6d8af339b8196d932391d64edd665c96/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,797 INFO [StoreOpener-6d8af339b8196d932391d64edd665c96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:58,798 DEBUG [StoreOpener-6d8af339b8196d932391d64edd665c96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2 2023-02-13 20:03:58,799 INFO [StoreOpener-6d8af339b8196d932391d64edd665c96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6d8af339b8196d932391d64edd665c96 columnFamilyName f2 2023-02-13 20:03:58,803 DEBUG [StoreOpener-6d8af339b8196d932391d64edd665c96-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2/testWithMockedMapReduceMultiRegion=6d8af339b8196d932391d64edd665c96-0948955c395246ef8a1be2f9b5434b7e 2023-02-13 20:03:58,803 INFO [StoreOpener-6d8af339b8196d932391d64edd665c96-1] regionserver.HStore(310): Store=6d8af339b8196d932391d64edd665c96/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,803 DEBUG [Listener at localhost/37999] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:58,803 INFO [Listener at localhost/37999] regionserver.HRegion(1071): Opened 6d8af339b8196d932391d64edd665c96; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61441949, jitterRate=-0.08444361388683319}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:58,804 DEBUG [Listener at localhost/37999] regionserver.HRegion(964): Region open journal for 6d8af339b8196d932391d64edd665c96: Writing region info on filesystem at 1676318638784Initializing all the Stores at 1676318638784Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638784Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638788 (+4 ms)Region opened successfully at 1676318638803 (+15 ms) 2023-02-13 20:03:58,812 DEBUG [Listener at localhost/37999] regionserver.HRegion(1603): Closing 6d8af339b8196d932391d64edd665c96, disabling compactions & flushes 2023-02-13 20:03:58,812 INFO [Listener at localhost/37999] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:58,812 DEBUG [Listener at localhost/37999] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:58,812 DEBUG [Listener at localhost/37999] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. after waiting 0 ms 2023-02-13 20:03:58,812 DEBUG [Listener at localhost/37999] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:58,813 INFO [Listener at localhost/37999] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:58,813 DEBUG [Listener at localhost/37999] regionserver.HRegion(1557): Region close journal for 6d8af339b8196d932391d64edd665c96: Waiting for close lock at 1676318638812Disabling compacts and flushes for region at 1676318638812Disabling writes for close at 1676318638812Writing region close event to WAL at 1676318638813 (+1 ms)Closed at 1676318638813 2023-02-13 20:03:58,814 DEBUG [Listener at localhost/37999] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:03:58,814 INFO [Listener at localhost/37999] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:03:58,816 DEBUG [Listener at localhost/37999] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:03:58,818 INFO [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:58,819 DEBUG [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1 2023-02-13 20:03:58,819 INFO [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa573645573a18bc6f2a0e4754d288ac columnFamilyName f1 2023-02-13 20:03:58,823 DEBUG [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1/testWithMockedMapReduceMultiRegion=aa573645573a18bc6f2a0e4754d288ac-d6fbd7d7c99f41e6b4489bc643583a1e 2023-02-13 20:03:58,823 INFO [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] regionserver.HStore(310): Store=aa573645573a18bc6f2a0e4754d288ac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,823 INFO [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:58,823 DEBUG [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2 2023-02-13 20:03:58,824 INFO [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aa573645573a18bc6f2a0e4754d288ac columnFamilyName f2 2023-02-13 20:03:58,827 DEBUG [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] regionserver.HStore(539): loaded hdfs://localhost:36121/user/jenkins/test-data/4d7fdfd6-96cb-33fe-3cf8-998d6084851b/testWithMockedMapReduceMultiRegion/0f8a4b6e-eeb6-40da-bae2-06f6ea1357a3/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2/testWithMockedMapReduceMultiRegion=aa573645573a18bc6f2a0e4754d288ac-eef2a80905524586be80a6e225a2a98c 2023-02-13 20:03:58,827 INFO [StoreOpener-aa573645573a18bc6f2a0e4754d288ac-1] regionserver.HStore(310): Store=aa573645573a18bc6f2a0e4754d288ac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:03:58,827 DEBUG [Listener at localhost/37999] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:03:58,828 INFO [Listener at localhost/37999] regionserver.HRegion(1071): Opened aa573645573a18bc6f2a0e4754d288ac; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64394509, jitterRate=-0.040447041392326355}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:03:58,828 DEBUG [Listener at localhost/37999] regionserver.HRegion(964): Region open journal for aa573645573a18bc6f2a0e4754d288ac: Writing region info on filesystem at 1676318638816Initializing all the Stores at 1676318638817 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638817Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318638817Region opened successfully at 1676318638828 (+11 ms) 2023-02-13 20:03:58,837 DEBUG [Listener at localhost/37999] regionserver.HRegion(1603): Closing aa573645573a18bc6f2a0e4754d288ac, disabling compactions & flushes 2023-02-13 20:03:58,837 INFO [Listener at localhost/37999] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:58,837 DEBUG [Listener at localhost/37999] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:58,837 DEBUG [Listener at localhost/37999] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. after waiting 0 ms 2023-02-13 20:03:58,837 DEBUG [Listener at localhost/37999] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:58,838 INFO [Listener at localhost/37999] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:58,838 DEBUG [Listener at localhost/37999] regionserver.HRegion(1557): Region close journal for aa573645573a18bc6f2a0e4754d288ac: Waiting for close lock at 1676318638837Disabling compacts and flushes for region at 1676318638837Disabling writes for close at 1676318638837Writing region close event to WAL at 1676318638838 (+1 ms)Closed at 1676318638838 2023-02-13 20:03:58,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-13 20:03:58,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-13 20:03:58,846 INFO [Listener at localhost/37999] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-13 20:03:58,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-13 20:03:58,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:58,850 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318638849"}]},"ts":"1676318638849"} 2023-02-13 20:03:58,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 20:03:58,851 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-13 20:03:58,852 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-13 20:03:58,853 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8283b462cfc3827ec6600a627cdc3ea9, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=05b94c5c2cb310d1dbc3f76b21d43ddd, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=30abf7b2bd989093bfa8f0915228b4af, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=41d40ad779288da6affe5207d3bf4cf7, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6d8af339b8196d932391d64edd665c96, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f626f495a03c4e88c154830cde7650f, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33fc22da8f96cfa31d8d05d8eda1bd2d, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8aae60631241dfab8a874b3907b9e7f5, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa573645573a18bc6f2a0e4754d288ac, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8927c608cb12d2eddba4aa6130140dfa, UNASSIGN}] 2023-02-13 20:03:58,855 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=30abf7b2bd989093bfa8f0915228b4af, UNASSIGN 2023-02-13 20:03:58,855 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=05b94c5c2cb310d1dbc3f76b21d43ddd, UNASSIGN 2023-02-13 20:03:58,855 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8283b462cfc3827ec6600a627cdc3ea9, UNASSIGN 2023-02-13 20:03:58,856 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6d8af339b8196d932391d64edd665c96, UNASSIGN 2023-02-13 20:03:58,856 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8927c608cb12d2eddba4aa6130140dfa, UNASSIGN 2023-02-13 20:03:58,856 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=30abf7b2bd989093bfa8f0915228b4af, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:58,856 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=05b94c5c2cb310d1dbc3f76b21d43ddd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:58,856 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318638856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318638856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318638856"}]},"ts":"1676318638856"} 2023-02-13 20:03:58,856 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318638856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318638856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318638856"}]},"ts":"1676318638856"} 2023-02-13 20:03:58,856 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8927c608cb12d2eddba4aa6130140dfa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:58,856 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6d8af339b8196d932391d64edd665c96, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:58,857 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676318638856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318638856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318638856"}]},"ts":"1676318638856"} 2023-02-13 20:03:58,856 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=8283b462cfc3827ec6600a627cdc3ea9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:58,857 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318638856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318638856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318638856"}]},"ts":"1676318638856"} 2023-02-13 20:03:58,857 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676318638856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318638856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318638856"}]},"ts":"1676318638856"} 2023-02-13 20:03:58,858 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure 30abf7b2bd989093bfa8f0915228b4af, server=jenkins-hbase4.apache.org,35987,1676318633072}] 2023-02-13 20:03:58,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=35, state=RUNNABLE; CloseRegionProcedure 05b94c5c2cb310d1dbc3f76b21d43ddd, server=jenkins-hbase4.apache.org,35987,1676318633072}] 2023-02-13 20:03:58,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; CloseRegionProcedure 8927c608cb12d2eddba4aa6130140dfa, server=jenkins-hbase4.apache.org,35759,1676318633044}] 2023-02-13 20:03:58,860 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=38, state=RUNNABLE; CloseRegionProcedure 6d8af339b8196d932391d64edd665c96, server=jenkins-hbase4.apache.org,35759,1676318633044}] 2023-02-13 20:03:58,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=34, state=RUNNABLE; CloseRegionProcedure 8283b462cfc3827ec6600a627cdc3ea9, server=jenkins-hbase4.apache.org,35759,1676318633044}] 2023-02-13 20:03:58,861 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa573645573a18bc6f2a0e4754d288ac, UNASSIGN 2023-02-13 20:03:58,861 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8aae60631241dfab8a874b3907b9e7f5, UNASSIGN 2023-02-13 20:03:58,861 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33fc22da8f96cfa31d8d05d8eda1bd2d, UNASSIGN 2023-02-13 20:03:58,861 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=aa573645573a18bc6f2a0e4754d288ac, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:58,861 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=8aae60631241dfab8a874b3907b9e7f5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:58,862 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318638861"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318638861"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318638861"}]},"ts":"1676318638861"} 2023-02-13 20:03:58,862 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318638861"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318638861"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318638861"}]},"ts":"1676318638861"} 2023-02-13 20:03:58,862 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=33fc22da8f96cfa31d8d05d8eda1bd2d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:58,862 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318638862"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318638862"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318638862"}]},"ts":"1676318638862"} 2023-02-13 20:03:58,863 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f626f495a03c4e88c154830cde7650f, UNASSIGN 2023-02-13 20:03:58,863 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=41d40ad779288da6affe5207d3bf4cf7, UNASSIGN 2023-02-13 20:03:58,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure aa573645573a18bc6f2a0e4754d288ac, server=jenkins-hbase4.apache.org,35987,1676318633072}] 2023-02-13 20:03:58,864 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=1f626f495a03c4e88c154830cde7650f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:58,864 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318638864"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318638864"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318638864"}]},"ts":"1676318638864"} 2023-02-13 20:03:58,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 8aae60631241dfab8a874b3907b9e7f5, server=jenkins-hbase4.apache.org,35759,1676318633044}] 2023-02-13 20:03:58,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 33fc22da8f96cfa31d8d05d8eda1bd2d, server=jenkins-hbase4.apache.org,35987,1676318633072}] 2023-02-13 20:03:58,864 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=41d40ad779288da6affe5207d3bf4cf7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:58,864 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318638864"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318638864"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318638864"}]},"ts":"1676318638864"} 2023-02-13 20:03:58,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 1f626f495a03c4e88c154830cde7650f, server=jenkins-hbase4.apache.org,35987,1676318633072}] 2023-02-13 20:03:58,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=37, state=RUNNABLE; CloseRegionProcedure 41d40ad779288da6affe5207d3bf4cf7, server=jenkins-hbase4.apache.org,35759,1676318633044}] 2023-02-13 20:03:58,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 20:03:59,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:59,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing aa573645573a18bc6f2a0e4754d288ac, disabling compactions & flushes 2023-02-13 20:03:59,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:59,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:59,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. after waiting 0 ms 2023-02-13 20:03:59,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:59,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:59,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8283b462cfc3827ec6600a627cdc3ea9, disabling compactions & flushes 2023-02-13 20:03:59,011 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:59,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:59,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. after waiting 0 ms 2023-02-13 20:03:59,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:59,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:59,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 20:03:59,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac. 2023-02-13 20:03:59,016 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for aa573645573a18bc6f2a0e4754d288ac: Waiting for close lock at 1676318639010Running coprocessor pre-close hooks at 1676318639010Disabling compacts and flushes for region at 1676318639010Disabling writes for close at 1676318639010Writing region close event to WAL at 1676318639011 (+1 ms)Running coprocessor post-close hooks at 1676318639015 (+4 ms)Closed at 1676318639016 (+1 ms) 2023-02-13 20:03:59,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9. 2023-02-13 20:03:59,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8283b462cfc3827ec6600a627cdc3ea9: Waiting for close lock at 1676318639011Running coprocessor pre-close hooks at 1676318639011Disabling compacts and flushes for region at 1676318639011Disabling writes for close at 1676318639011Writing region close event to WAL at 1676318639011Running coprocessor post-close hooks at 1676318639016 (+5 ms)Closed at 1676318639016 2023-02-13 20:03:59,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:59,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:59,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 05b94c5c2cb310d1dbc3f76b21d43ddd, disabling compactions & flushes 2023-02-13 20:03:59,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:59,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:59,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. after waiting 0 ms 2023-02-13 20:03:59,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:59,018 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=aa573645573a18bc6f2a0e4754d288ac, regionState=CLOSED 2023-02-13 20:03:59,018 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318639018"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318639018"}]},"ts":"1676318639018"} 2023-02-13 20:03:59,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:59,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:59,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8927c608cb12d2eddba4aa6130140dfa, disabling compactions & flushes 2023-02-13 20:03:59,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:59,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:59,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. after waiting 0 ms 2023-02-13 20:03:59,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:59,019 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=8283b462cfc3827ec6600a627cdc3ea9, regionState=CLOSED 2023-02-13 20:03:59,019 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676318639019"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318639019"}]},"ts":"1676318639019"} 2023-02-13 20:03:59,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-13 20:03:59,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure aa573645573a18bc6f2a0e4754d288ac, server=jenkins-hbase4.apache.org,35987,1676318633072 in 157 msec 2023-02-13 20:03:59,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=34 2023-02-13 20:03:59,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=34, state=SUCCESS; CloseRegionProcedure 8283b462cfc3827ec6600a627cdc3ea9, server=jenkins-hbase4.apache.org,35759,1676318633044 in 160 msec 2023-02-13 20:03:59,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=aa573645573a18bc6f2a0e4754d288ac, UNASSIGN in 168 msec 2023-02-13 20:03:59,023 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8283b462cfc3827ec6600a627cdc3ea9, UNASSIGN in 169 msec 2023-02-13 20:03:59,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 20:03:59,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa. 2023-02-13 20:03:59,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8927c608cb12d2eddba4aa6130140dfa: Waiting for close lock at 1676318639019Running coprocessor pre-close hooks at 1676318639019Disabling compacts and flushes for region at 1676318639019Disabling writes for close at 1676318639019Writing region close event to WAL at 1676318639020 (+1 ms)Running coprocessor post-close hooks at 1676318639031 (+11 ms)Closed at 1676318639032 (+1 ms) 2023-02-13 20:03:59,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:59,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:59,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:59,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 6d8af339b8196d932391d64edd665c96, disabling compactions & flushes 2023-02-13 20:03:59,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:59,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:59,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. after waiting 0 ms 2023-02-13 20:03:59,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd. 2023-02-13 20:03:59,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:59,034 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=8927c608cb12d2eddba4aa6130140dfa, regionState=CLOSED 2023-02-13 20:03:59,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 05b94c5c2cb310d1dbc3f76b21d43ddd: Waiting for close lock at 1676318639018Running coprocessor pre-close hooks at 1676318639018Disabling compacts and flushes for region at 1676318639018Disabling writes for close at 1676318639018Writing region close event to WAL at 1676318639029 (+11 ms)Running coprocessor post-close hooks at 1676318639034 (+5 ms)Closed at 1676318639035 (+1 ms) 2023-02-13 20:03:59,035 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676318639034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318639034"}]},"ts":"1676318639034"} 2023-02-13 20:03:59,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:59,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:59,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 30abf7b2bd989093bfa8f0915228b4af, disabling compactions & flushes 2023-02-13 20:03:59,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:59,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:59,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. after waiting 0 ms 2023-02-13 20:03:59,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:59,037 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=05b94c5c2cb310d1dbc3f76b21d43ddd, regionState=CLOSED 2023-02-13 20:03:59,037 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318639037"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318639037"}]},"ts":"1676318639037"} 2023-02-13 20:03:59,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:59,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-02-13 20:03:59,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; CloseRegionProcedure 8927c608cb12d2eddba4aa6130140dfa, server=jenkins-hbase4.apache.org,35759,1676318633044 in 177 msec 2023-02-13 20:03:59,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96. 2023-02-13 20:03:59,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 6d8af339b8196d932391d64edd665c96: Waiting for close lock at 1676318639033Running coprocessor pre-close hooks at 1676318639033Disabling compacts and flushes for region at 1676318639033Disabling writes for close at 1676318639035 (+2 ms)Writing region close event to WAL at 1676318639036 (+1 ms)Running coprocessor post-close hooks at 1676318639040 (+4 ms)Closed at 1676318639042 (+2 ms) 2023-02-13 20:03:59,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:59,042 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=35 2023-02-13 20:03:59,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8927c608cb12d2eddba4aa6130140dfa, UNASSIGN in 187 msec 2023-02-13 20:03:59,042 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=35, state=SUCCESS; CloseRegionProcedure 05b94c5c2cb310d1dbc3f76b21d43ddd, server=jenkins-hbase4.apache.org,35987,1676318633072 in 180 msec 2023-02-13 20:03:59,043 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af. 2023-02-13 20:03:59,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 30abf7b2bd989093bfa8f0915228b4af: Waiting for close lock at 1676318639036Running coprocessor pre-close hooks at 1676318639036Disabling compacts and flushes for region at 1676318639036Disabling writes for close at 1676318639036Writing region close event to WAL at 1676318639038 (+2 ms)Running coprocessor post-close hooks at 1676318639043 (+5 ms)Closed at 1676318639043 2023-02-13 20:03:59,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:59,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:59,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 41d40ad779288da6affe5207d3bf4cf7, disabling compactions & flushes 2023-02-13 20:03:59,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:59,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:59,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. after waiting 0 ms 2023-02-13 20:03:59,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:59,044 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=05b94c5c2cb310d1dbc3f76b21d43ddd, UNASSIGN in 189 msec 2023-02-13 20:03:59,044 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6d8af339b8196d932391d64edd665c96, regionState=CLOSED 2023-02-13 20:03:59,045 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318639044"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318639044"}]},"ts":"1676318639044"} 2023-02-13 20:03:59,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:59,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:59,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1f626f495a03c4e88c154830cde7650f, disabling compactions & flushes 2023-02-13 20:03:59,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:59,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:59,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. after waiting 0 ms 2023-02-13 20:03:59,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:59,045 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=30abf7b2bd989093bfa8f0915228b4af, regionState=CLOSED 2023-02-13 20:03:59,045 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318639045"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318639045"}]},"ts":"1676318639045"} 2023-02-13 20:03:59,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=38 2023-02-13 20:03:59,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=38, state=SUCCESS; CloseRegionProcedure 6d8af339b8196d932391d64edd665c96, server=jenkins-hbase4.apache.org,35759,1676318633044 in 186 msec 2023-02-13 20:03:59,049 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-13 20:03:59,049 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure 30abf7b2bd989093bfa8f0915228b4af, server=jenkins-hbase4.apache.org,35987,1676318633072 in 189 msec 2023-02-13 20:03:59,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=6d8af339b8196d932391d64edd665c96, UNASSIGN in 195 msec 2023-02-13 20:03:59,050 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=30abf7b2bd989093bfa8f0915228b4af, UNASSIGN in 196 msec 2023-02-13 20:03:59,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:59,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7. 2023-02-13 20:03:59,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 41d40ad779288da6affe5207d3bf4cf7: Waiting for close lock at 1676318639044Running coprocessor pre-close hooks at 1676318639044Disabling compacts and flushes for region at 1676318639044Disabling writes for close at 1676318639044Writing region close event to WAL at 1676318639048 (+4 ms)Running coprocessor post-close hooks at 1676318639052 (+4 ms)Closed at 1676318639053 (+1 ms) 2023-02-13 20:03:59,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:59,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f. 2023-02-13 20:03:59,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1f626f495a03c4e88c154830cde7650f: Waiting for close lock at 1676318639045Running coprocessor pre-close hooks at 1676318639045Disabling compacts and flushes for region at 1676318639045Disabling writes for close at 1676318639045Writing region close event to WAL at 1676318639047 (+2 ms)Running coprocessor post-close hooks at 1676318639054 (+7 ms)Closed at 1676318639055 (+1 ms) 2023-02-13 20:03:59,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:59,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:59,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8aae60631241dfab8a874b3907b9e7f5, disabling compactions & flushes 2023-02-13 20:03:59,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:59,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:59,055 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=41d40ad779288da6affe5207d3bf4cf7, regionState=CLOSED 2023-02-13 20:03:59,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. after waiting 0 ms 2023-02-13 20:03:59,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:59,055 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318639055"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318639055"}]},"ts":"1676318639055"} 2023-02-13 20:03:59,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:59,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:59,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 33fc22da8f96cfa31d8d05d8eda1bd2d, disabling compactions & flushes 2023-02-13 20:03:59,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:59,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:59,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. after waiting 0 ms 2023-02-13 20:03:59,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:59,057 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=1f626f495a03c4e88c154830cde7650f, regionState=CLOSED 2023-02-13 20:03:59,057 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318639057"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318639057"}]},"ts":"1676318639057"} 2023-02-13 20:03:59,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=37 2023-02-13 20:03:59,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=37, state=SUCCESS; CloseRegionProcedure 41d40ad779288da6affe5207d3bf4cf7, server=jenkins-hbase4.apache.org,35759,1676318633044 in 188 msec 2023-02-13 20:03:59,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-13 20:03:59,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 1f626f495a03c4e88c154830cde7650f, server=jenkins-hbase4.apache.org,35987,1676318633072 in 193 msec 2023-02-13 20:03:59,060 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=41d40ad779288da6affe5207d3bf4cf7, UNASSIGN in 206 msec 2023-02-13 20:03:59,061 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1f626f495a03c4e88c154830cde7650f, UNASSIGN in 207 msec 2023-02-13 20:03:59,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:59,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5. 2023-02-13 20:03:59,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8aae60631241dfab8a874b3907b9e7f5: Waiting for close lock at 1676318639055Running coprocessor pre-close hooks at 1676318639055Disabling compacts and flushes for region at 1676318639055Disabling writes for close at 1676318639055Writing region close event to WAL at 1676318639057 (+2 ms)Running coprocessor post-close hooks at 1676318639067 (+10 ms)Closed at 1676318639068 (+1 ms) 2023-02-13 20:03:59,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:03:59,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:59,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d. 2023-02-13 20:03:59,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 33fc22da8f96cfa31d8d05d8eda1bd2d: Waiting for close lock at 1676318639056Running coprocessor pre-close hooks at 1676318639056Disabling compacts and flushes for region at 1676318639056Disabling writes for close at 1676318639056Writing region close event to WAL at 1676318639066 (+10 ms)Running coprocessor post-close hooks at 1676318639070 (+4 ms)Closed at 1676318639071 (+1 ms) 2023-02-13 20:03:59,071 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=8aae60631241dfab8a874b3907b9e7f5, regionState=CLOSED 2023-02-13 20:03:59,072 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318639071"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318639071"}]},"ts":"1676318639071"} 2023-02-13 20:03:59,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:59,073 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=33fc22da8f96cfa31d8d05d8eda1bd2d, regionState=CLOSED 2023-02-13 20:03:59,073 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676318639073"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318639073"}]},"ts":"1676318639073"} 2023-02-13 20:03:59,074 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-13 20:03:59,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 8aae60631241dfab8a874b3907b9e7f5, server=jenkins-hbase4.apache.org,35759,1676318633044 in 209 msec 2023-02-13 20:03:59,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8aae60631241dfab8a874b3907b9e7f5, UNASSIGN in 221 msec 2023-02-13 20:03:59,076 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-13 20:03:59,076 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 33fc22da8f96cfa31d8d05d8eda1bd2d, server=jenkins-hbase4.apache.org,35987,1676318633072 in 210 msec 2023-02-13 20:03:59,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=33 2023-02-13 20:03:59,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=33fc22da8f96cfa31d8d05d8eda1bd2d, UNASSIGN in 223 msec 2023-02-13 20:03:59,077 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318639077"}]},"ts":"1676318639077"} 2023-02-13 20:03:59,078 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-13 20:03:59,080 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-13 20:03:59,081 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 234 msec 2023-02-13 20:03:59,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 20:03:59,153 INFO [Listener at localhost/37999] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-13 20:03:59,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-13 20:03:59,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:59,157 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:59,158 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:59,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 20:03:59,169 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:59,169 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:59,169 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:59,169 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:59,169 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:59,169 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:59,169 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:59,169 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:59,172 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9/f1, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9/f2, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9/recovered.edits] 2023-02-13 20:03:59,172 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/recovered.edits] 2023-02-13 20:03:59,173 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/recovered.edits] 2023-02-13 20:03:59,173 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/recovered.edits] 2023-02-13 20:03:59,173 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/recovered.edits] 2023-02-13 20:03:59,173 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/recovered.edits] 2023-02-13 20:03:59,173 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/recovered.edits] 2023-02-13 20:03:59,173 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/recovered.edits] 2023-02-13 20:03:59,178 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1/fc2436639c2845d38d2d8368c859afd2 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1/fc2436639c2845d38d2d8368c859afd2 2023-02-13 20:03:59,179 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1/4f3040efe1f145fb9a1084f30f76b67b to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1/4f3040efe1f145fb9a1084f30f76b67b 2023-02-13 20:03:59,180 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1/0c748b53a43b42dda44adb3e2cdd2414 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1/0c748b53a43b42dda44adb3e2cdd2414 2023-02-13 20:03:59,181 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1/fefc705c2ce94398b30c69355af2e379 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f1/fefc705c2ce94398b30c69355af2e379 2023-02-13 20:03:59,181 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1/d801a66ba06f45a5ac7fbef69bf97237 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1/d801a66ba06f45a5ac7fbef69bf97237 2023-02-13 20:03:59,182 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1/2922203fd92b43bd9b3ebb1a9b86b8bd to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1/2922203fd92b43bd9b3ebb1a9b86b8bd 2023-02-13 20:03:59,182 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1/f25678b0925849bba34fe479e3a2beb5 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f1/f25678b0925849bba34fe479e3a2beb5 2023-02-13 20:03:59,182 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1/d6591f4c98a7495eabad151c7ff69126 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1/d6591f4c98a7495eabad151c7ff69126 2023-02-13 20:03:59,183 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1/26d135cef99d4b48aab954eedb6dbc3a to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1/26d135cef99d4b48aab954eedb6dbc3a 2023-02-13 20:03:59,183 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1/894df0dfdd2d4613b48ee41af1eacab5 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f1/894df0dfdd2d4613b48ee41af1eacab5 2023-02-13 20:03:59,184 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1/e235cf35727a49f0ba0dfceca6d4d7a7 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f1/e235cf35727a49f0ba0dfceca6d4d7a7 2023-02-13 20:03:59,185 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1/fb1f7060fb30452ba078716174ffa333 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f1/fb1f7060fb30452ba078716174ffa333 2023-02-13 20:03:59,185 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1/ecc1d539f6c0473d989cae479bc6ce59 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f1/ecc1d539f6c0473d989cae479bc6ce59 2023-02-13 20:03:59,185 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1/dd5b0f7f9dab4e80b6cc40404e2d6141 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f1/dd5b0f7f9dab4e80b6cc40404e2d6141 2023-02-13 20:03:59,186 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9/recovered.edits/6.seqid to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9/recovered.edits/6.seqid 2023-02-13 20:03:59,187 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2/0948955c395246ef8a1be2f9b5434b7e to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2/0948955c395246ef8a1be2f9b5434b7e 2023-02-13 20:03:59,187 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8283b462cfc3827ec6600a627cdc3ea9 2023-02-13 20:03:59,187 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:59,190 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2/286317e7fbdb4d34b9037fda92af3672 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/f2/286317e7fbdb4d34b9037fda92af3672 2023-02-13 20:03:59,190 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2/16f2e31f32a74be7ba13ed81f9032fa9 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2/16f2e31f32a74be7ba13ed81f9032fa9 2023-02-13 20:03:59,190 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2/17d6528c6ed64639a93eb1b27ca1b6d6 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2/17d6528c6ed64639a93eb1b27ca1b6d6 2023-02-13 20:03:59,190 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2/b7136a6d996b4a2eb0d4a3152cd0a507 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2/b7136a6d996b4a2eb0d4a3152cd0a507 2023-02-13 20:03:59,191 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/recovered.edits] 2023-02-13 20:03:59,191 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2/6ba14a1bdba14580a230dafe4ac8f4d5 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2/6ba14a1bdba14580a230dafe4ac8f4d5 2023-02-13 20:03:59,192 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2/a9d65da9142840639c2e178c79d6f0fa to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2/a9d65da9142840639c2e178c79d6f0fa 2023-02-13 20:03:59,192 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2/42066f2f339d457bb33e4b6159bb1967 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/f2/42066f2f339d457bb33e4b6159bb1967 2023-02-13 20:03:59,193 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2/e0ce090ca39044468ada449f658db6f1 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/f2/e0ce090ca39044468ada449f658db6f1 2023-02-13 20:03:59,193 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2/9755e63740664aa79e9b3e483f4c2b76 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2/9755e63740664aa79e9b3e483f4c2b76 2023-02-13 20:03:59,193 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2/d1343fc022f6446cac6153ac14c7e8cf to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/f2/d1343fc022f6446cac6153ac14c7e8cf 2023-02-13 20:03:59,193 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2/8ea63079bce94a8ca57c052e85fc7c58 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/f2/8ea63079bce94a8ca57c052e85fc7c58 2023-02-13 20:03:59,195 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2/c6048ee5a9da4d809a19e04b2b5e4218 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/f2/c6048ee5a9da4d809a19e04b2b5e4218 2023-02-13 20:03:59,196 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2/cfb9db51b8db4f1790b52b405b555412 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/f2/cfb9db51b8db4f1790b52b405b555412 2023-02-13 20:03:59,197 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/recovered.edits/12.seqid to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96/recovered.edits/12.seqid 2023-02-13 20:03:59,198 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/recovered.edits/12.seqid to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd/recovered.edits/12.seqid 2023-02-13 20:03:59,198 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1/520b237ae114447f9e2b97863c5d0cd5 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1/520b237ae114447f9e2b97863c5d0cd5 2023-02-13 20:03:59,198 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/6d8af339b8196d932391d64edd665c96 2023-02-13 20:03:59,198 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:59,199 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/05b94c5c2cb310d1dbc3f76b21d43ddd 2023-02-13 20:03:59,200 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/recovered.edits/12.seqid to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af/recovered.edits/12.seqid 2023-02-13 20:03:59,200 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/recovered.edits/12.seqid to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5/recovered.edits/12.seqid 2023-02-13 20:03:59,200 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/recovered.edits/12.seqid to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d/recovered.edits/12.seqid 2023-02-13 20:03:59,201 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/30abf7b2bd989093bfa8f0915228b4af 2023-02-13 20:03:59,201 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8aae60631241dfab8a874b3907b9e7f5 2023-02-13 20:03:59,201 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1/d6fbd7d7c99f41e6b4489bc643583a1e to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f1/d6fbd7d7c99f41e6b4489bc643583a1e 2023-02-13 20:03:59,201 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/recovered.edits/12.seqid to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7/recovered.edits/12.seqid 2023-02-13 20:03:59,201 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/33fc22da8f96cfa31d8d05d8eda1bd2d 2023-02-13 20:03:59,201 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa/f1, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa/f2, FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa/recovered.edits] 2023-02-13 20:03:59,202 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/41d40ad779288da6affe5207d3bf4cf7 2023-02-13 20:03:59,202 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/recovered.edits/12.seqid to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f/recovered.edits/12.seqid 2023-02-13 20:03:59,203 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/1f626f495a03c4e88c154830cde7650f 2023-02-13 20:03:59,204 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2/5bc2eb380ca140368ae60ef1643c43e8 to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2/5bc2eb380ca140368ae60ef1643c43e8 2023-02-13 20:03:59,206 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2/eef2a80905524586be80a6e225a2a98c to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/f2/eef2a80905524586be80a6e225a2a98c 2023-02-13 20:03:59,207 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa/recovered.edits/6.seqid to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa/recovered.edits/6.seqid 2023-02-13 20:03:59,208 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/8927c608cb12d2eddba4aa6130140dfa 2023-02-13 20:03:59,209 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/recovered.edits/12.seqid to hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/archive/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac/recovered.edits/12.seqid 2023-02-13 20:03:59,210 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/.tmp/data/default/testWithMockedMapReduceMultiRegion/aa573645573a18bc6f2a0e4754d288ac 2023-02-13 20:03:59,210 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-13 20:03:59,212 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:59,215 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-13 20:03:59,218 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-13 20:03:59,219 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:59,219 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-13 20:03:59,219 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318639219"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:59,219 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318639219"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:59,219 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318639219"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:59,220 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318639219"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:59,220 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318639219"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:59,220 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318639219"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:59,220 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318639219"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:59,220 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318639219"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:59,220 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318639219"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:59,220 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318639219"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:59,222 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-13 20:03:59,222 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8283b462cfc3827ec6600a627cdc3ea9, NAME => 'testWithMockedMapReduceMultiRegion,,1676318634312.8283b462cfc3827ec6600a627cdc3ea9.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 05b94c5c2cb310d1dbc3f76b21d43ddd, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676318634312.05b94c5c2cb310d1dbc3f76b21d43ddd.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 30abf7b2bd989093bfa8f0915228b4af, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676318634312.30abf7b2bd989093bfa8f0915228b4af.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 41d40ad779288da6affe5207d3bf4cf7, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676318634312.41d40ad779288da6affe5207d3bf4cf7.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 6d8af339b8196d932391d64edd665c96, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676318634312.6d8af339b8196d932391d64edd665c96.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 1f626f495a03c4e88c154830cde7650f, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676318634312.1f626f495a03c4e88c154830cde7650f.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 33fc22da8f96cfa31d8d05d8eda1bd2d, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676318634312.33fc22da8f96cfa31d8d05d8eda1bd2d.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 8aae60631241dfab8a874b3907b9e7f5, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676318634312.8aae60631241dfab8a874b3907b9e7f5.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => aa573645573a18bc6f2a0e4754d288ac, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676318634312.aa573645573a18bc6f2a0e4754d288ac.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 8927c608cb12d2eddba4aa6130140dfa, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676318634312.8927c608cb12d2eddba4aa6130140dfa.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-13 20:03:59,222 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-13 20:03:59,222 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676318639222"}]},"ts":"9223372036854775807"} 2023-02-13 20:03:59,224 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-13 20:03:59,226 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 20:03:59,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 72 msec 2023-02-13 20:03:59,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43055] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 20:03:59,260 INFO [Listener at localhost/37999] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-13 20:03:59,260 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 20:03:59,260 INFO [Listener at localhost/37999] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 20:03:59,261 DEBUG [Listener at localhost/37999] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49d796e9 to 127.0.0.1:56374 2023-02-13 20:03:59,261 DEBUG [Listener at localhost/37999] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:59,261 DEBUG [Listener at localhost/37999] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 20:03:59,261 DEBUG [Listener at localhost/37999] util.JVMClusterUtil(257): Found active master hash=1978614382, stopped=false 2023-02-13 20:03:59,261 INFO [Listener at localhost/37999] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43055,1676318632997 2023-02-13 20:03:59,264 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:59,264 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:59,264 INFO [Listener at localhost/37999] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 20:03:59,264 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:03:59,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:59,267 DEBUG [Listener at localhost/37999] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f4b58e4 to 127.0.0.1:56374 2023-02-13 20:03:59,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:59,267 DEBUG [Listener at localhost/37999] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:59,267 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:59,267 INFO [Listener at localhost/37999] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35759,1676318633044' ***** 2023-02-13 20:03:59,267 INFO [Listener at localhost/37999] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:03:59,267 INFO [Listener at localhost/37999] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35987,1676318633072' ***** 2023-02-13 20:03:59,267 INFO [Listener at localhost/37999] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:03:59,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:03:59,267 INFO [RS:1;jenkins-hbase4:35987] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:03:59,268 INFO [RS:1;jenkins-hbase4:35987] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:03:59,268 INFO [RS:0;jenkins-hbase4:35759] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:03:59,268 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:03:59,268 INFO [RS:0;jenkins-hbase4:35759] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:03:59,268 INFO [RS:0;jenkins-hbase4:35759] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:03:59,268 INFO [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(3304): Received CLOSE for fdb64b82c98eff555990616b21e4909e 2023-02-13 20:03:59,268 INFO [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:59,268 DEBUG [RS:0;jenkins-hbase4:35759] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c9cd129 to 127.0.0.1:56374 2023-02-13 20:03:59,268 DEBUG [RS:0;jenkins-hbase4:35759] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:59,268 INFO [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 20:03:59,268 DEBUG [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(1479): Online Regions={fdb64b82c98eff555990616b21e4909e=hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e.} 2023-02-13 20:03:59,268 DEBUG [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(1505): Waiting on fdb64b82c98eff555990616b21e4909e 2023-02-13 20:03:59,268 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:03:59,268 INFO [RS:1;jenkins-hbase4:35987] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:03:59,268 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:59,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing fdb64b82c98eff555990616b21e4909e, disabling compactions & flushes 2023-02-13 20:03:59,270 INFO [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:59,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. 2023-02-13 20:03:59,270 DEBUG [RS:1;jenkins-hbase4:35987] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18957a2c to 127.0.0.1:56374 2023-02-13 20:03:59,270 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. 2023-02-13 20:03:59,271 DEBUG [RS:1;jenkins-hbase4:35987] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:59,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. after waiting 0 ms 2023-02-13 20:03:59,271 INFO [RS:1;jenkins-hbase4:35987] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:03:59,271 INFO [RS:1;jenkins-hbase4:35987] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:03:59,271 INFO [RS:1;jenkins-hbase4:35987] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:03:59,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. 2023-02-13 20:03:59,271 INFO [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 20:03:59,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing fdb64b82c98eff555990616b21e4909e 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 20:03:59,271 INFO [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 20:03:59,271 DEBUG [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 20:03:59,271 DEBUG [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 20:03:59,273 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:03:59,273 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:03:59,273 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:03:59,273 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:03:59,273 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:03:59,274 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-13 20:03:59,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/namespace/fdb64b82c98eff555990616b21e4909e/.tmp/info/3cae7243f01144829fc06c78837bc12c 2023-02-13 20:03:59,284 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/.tmp/info/c6d63eb099384143b745b05a4b9f1bcc 2023-02-13 20:03:59,287 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c6d63eb099384143b745b05a4b9f1bcc 2023-02-13 20:03:59,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/namespace/fdb64b82c98eff555990616b21e4909e/.tmp/info/3cae7243f01144829fc06c78837bc12c as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/namespace/fdb64b82c98eff555990616b21e4909e/info/3cae7243f01144829fc06c78837bc12c 2023-02-13 20:03:59,295 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/.tmp/rep_barrier/0b78d83bf2b1432a9c4260a2f3768124 2023-02-13 20:03:59,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/namespace/fdb64b82c98eff555990616b21e4909e/info/3cae7243f01144829fc06c78837bc12c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 20:03:59,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fdb64b82c98eff555990616b21e4909e in 28ms, sequenceid=6, compaction requested=false 2023-02-13 20:03:59,305 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b78d83bf2b1432a9c4260a2f3768124 2023-02-13 20:03:59,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/namespace/fdb64b82c98eff555990616b21e4909e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 20:03:59,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. 2023-02-13 20:03:59,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for fdb64b82c98eff555990616b21e4909e: Waiting for close lock at 1676318639268Running coprocessor pre-close hooks at 1676318639268Disabling compacts and flushes for region at 1676318639268Disabling writes for close at 1676318639271 (+3 ms)Obtaining lock to block concurrent updates at 1676318639271Preparing flush snapshotting stores in fdb64b82c98eff555990616b21e4909e at 1676318639271Finished memstore snapshotting hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676318639271Flushing stores of hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. at 1676318639274 (+3 ms)Flushing fdb64b82c98eff555990616b21e4909e/info: creating writer at 1676318639274Flushing fdb64b82c98eff555990616b21e4909e/info: appending metadata at 1676318639276 (+2 ms)Flushing fdb64b82c98eff555990616b21e4909e/info: closing flushed file at 1676318639276Flushing fdb64b82c98eff555990616b21e4909e/info: reopening flushed file at 1676318639293 (+17 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fdb64b82c98eff555990616b21e4909e in 28ms, sequenceid=6, compaction requested=false at 1676318639299 (+6 ms)Writing region close event to WAL at 1676318639304 (+5 ms)Running coprocessor post-close hooks at 1676318639307 (+3 ms)Closed at 1676318639308 (+1 ms) 2023-02-13 20:03:59,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676318633660.fdb64b82c98eff555990616b21e4909e. 2023-02-13 20:03:59,323 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/.tmp/table/d460e2407305442da338e5580fcd1579 2023-02-13 20:03:59,327 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d460e2407305442da338e5580fcd1579 2023-02-13 20:03:59,328 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/.tmp/info/c6d63eb099384143b745b05a4b9f1bcc as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/info/c6d63eb099384143b745b05a4b9f1bcc 2023-02-13 20:03:59,332 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c6d63eb099384143b745b05a4b9f1bcc 2023-02-13 20:03:59,332 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/info/c6d63eb099384143b745b05a4b9f1bcc, entries=30, sequenceid=57, filesize=8.3 K 2023-02-13 20:03:59,333 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/.tmp/rep_barrier/0b78d83bf2b1432a9c4260a2f3768124 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/rep_barrier/0b78d83bf2b1432a9c4260a2f3768124 2023-02-13 20:03:59,336 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b78d83bf2b1432a9c4260a2f3768124 2023-02-13 20:03:59,336 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/rep_barrier/0b78d83bf2b1432a9c4260a2f3768124, entries=10, sequenceid=57, filesize=6.1 K 2023-02-13 20:03:59,337 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/.tmp/table/d460e2407305442da338e5580fcd1579 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/table/d460e2407305442da338e5580fcd1579 2023-02-13 20:03:59,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d460e2407305442da338e5580fcd1579 2023-02-13 20:03:59,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/table/d460e2407305442da338e5580fcd1579, entries=13, sequenceid=57, filesize=6.1 K 2023-02-13 20:03:59,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=57, compaction requested=false 2023-02-13 20:03:59,345 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-13 20:03:59,345 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 20:03:59,346 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:03:59,347 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318639271Running coprocessor pre-close hooks at 1676318639271Disabling compacts and flushes for region at 1676318639271Disabling writes for close at 1676318639273 (+2 ms)Obtaining lock to block concurrent updates at 1676318639274 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676318639274Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1676318639274Flushing stores of hbase:meta,,1.1588230740 at 1676318639274Flushing 1588230740/info: creating writer at 1676318639274Flushing 1588230740/info: appending metadata at 1676318639278 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676318639278Flushing 1588230740/rep_barrier: creating writer at 1676318639287 (+9 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676318639289 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676318639289Flushing 1588230740/table: creating writer at 1676318639306 (+17 ms)Flushing 1588230740/table: appending metadata at 1676318639310 (+4 ms)Flushing 1588230740/table: closing flushed file at 1676318639310Flushing 1588230740/info: reopening flushed file at 1676318639328 (+18 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676318639333 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676318639338 (+5 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=57, compaction requested=false at 1676318639342 (+4 ms)Writing region close event to WAL at 1676318639342Running coprocessor post-close hooks at 1676318639345 (+3 ms)Closed at 1676318639346 (+1 ms) 2023-02-13 20:03:59,347 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 20:03:59,352 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 20:03:59,352 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 20:03:59,363 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 20:03:59,363 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 20:03:59,365 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:59,468 INFO [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35759,1676318633044; all regions closed. 2023-02-13 20:03:59,473 INFO [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35987,1676318633072; all regions closed. 2023-02-13 20:03:59,474 DEBUG [RS:0;jenkins-hbase4:35759] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/oldWALs 2023-02-13 20:03:59,474 INFO [RS:0;jenkins-hbase4:35759] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35759%2C1676318633044:(num 1676318634030) 2023-02-13 20:03:59,477 DEBUG [RS:0;jenkins-hbase4:35759] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:59,477 INFO [RS:0;jenkins-hbase4:35759] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:59,477 INFO [RS:0;jenkins-hbase4:35759] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 20:03:59,477 INFO [RS:0;jenkins-hbase4:35759] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:03:59,477 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:03:59,477 INFO [RS:0;jenkins-hbase4:35759] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:03:59,477 INFO [RS:0;jenkins-hbase4:35759] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:03:59,478 INFO [RS:0;jenkins-hbase4:35759] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35759 2023-02-13 20:03:59,480 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:59,480 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:59,480 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35759,1676318633044 2023-02-13 20:03:59,481 ERROR [Listener at localhost/37999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1e222702 rejected from java.util.concurrent.ThreadPoolExecutor@1a1da01e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:59,481 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:59,481 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:59,481 ERROR [Listener at localhost/37999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@611f230f rejected from java.util.concurrent.ThreadPoolExecutor@1a1da01e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:59,481 DEBUG [RS:1;jenkins-hbase4:35987] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/oldWALs 2023-02-13 20:03:59,481 INFO [RS:1;jenkins-hbase4:35987] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35987%2C1676318633072.meta:.meta(num 1676318633604) 2023-02-13 20:03:59,482 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35759,1676318633044] 2023-02-13 20:03:59,482 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35759,1676318633044; numProcessing=1 2023-02-13 20:03:59,484 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35759,1676318633044 already deleted, retry=false 2023-02-13 20:03:59,484 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35759,1676318633044 expired; onlineServers=1 2023-02-13 20:03:59,484 DEBUG [RS:1;jenkins-hbase4:35987] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/oldWALs 2023-02-13 20:03:59,484 INFO [RS:1;jenkins-hbase4:35987] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35987%2C1676318633072:(num 1676318634392) 2023-02-13 20:03:59,484 DEBUG [RS:1;jenkins-hbase4:35987] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:59,484 INFO [RS:1;jenkins-hbase4:35987] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:03:59,485 INFO [RS:1;jenkins-hbase4:35987] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 20:03:59,485 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:03:59,486 INFO [RS:1;jenkins-hbase4:35987] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35987 2023-02-13 20:03:59,488 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35987,1676318633072 2023-02-13 20:03:59,488 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:03:59,488 ERROR [Listener at localhost/37999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@72417a1 rejected from java.util.concurrent.ThreadPoolExecutor@31b839d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:59,490 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35987,1676318633072] 2023-02-13 20:03:59,490 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35987,1676318633072; numProcessing=2 2023-02-13 20:03:59,491 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35987,1676318633072 already deleted, retry=false 2023-02-13 20:03:59,491 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35987,1676318633072 expired; onlineServers=0 2023-02-13 20:03:59,491 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43055,1676318632997' ***** 2023-02-13 20:03:59,491 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 20:03:59,492 DEBUG [M:0;jenkins-hbase4:43055] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71d0d80b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:03:59,492 INFO [M:0;jenkins-hbase4:43055] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43055,1676318632997 2023-02-13 20:03:59,492 INFO [M:0;jenkins-hbase4:43055] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43055,1676318632997; all regions closed. 2023-02-13 20:03:59,492 DEBUG [M:0;jenkins-hbase4:43055] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:03:59,492 DEBUG [M:0;jenkins-hbase4:43055] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 20:03:59,492 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 20:03:59,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318633243] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318633243,5,FailOnTimeoutGroup] 2023-02-13 20:03:59,492 DEBUG [M:0;jenkins-hbase4:43055] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 20:03:59,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318633243] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318633243,5,FailOnTimeoutGroup] 2023-02-13 20:03:59,493 INFO [M:0;jenkins-hbase4:43055] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 20:03:59,493 INFO [M:0;jenkins-hbase4:43055] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 20:03:59,494 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 20:03:59,494 INFO [M:0;jenkins-hbase4:43055] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 20:03:59,494 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:03:59,494 DEBUG [M:0;jenkins-hbase4:43055] master.HMaster(1502): Stopping service threads 2023-02-13 20:03:59,494 INFO [M:0;jenkins-hbase4:43055] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 20:03:59,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:03:59,494 ERROR [M:0;jenkins-hbase4:43055] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 20:03:59,495 INFO [M:0;jenkins-hbase4:43055] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 20:03:59,495 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 20:03:59,495 DEBUG [M:0;jenkins-hbase4:43055] zookeeper.ZKUtil(398): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 20:03:59,495 WARN [M:0;jenkins-hbase4:43055] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 20:03:59,495 INFO [M:0;jenkins-hbase4:43055] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 20:03:59,496 INFO [M:0;jenkins-hbase4:43055] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 20:03:59,496 DEBUG [M:0;jenkins-hbase4:43055] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:03:59,496 INFO [M:0;jenkins-hbase4:43055] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:59,496 DEBUG [M:0;jenkins-hbase4:43055] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:59,496 DEBUG [M:0;jenkins-hbase4:43055] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:03:59,496 DEBUG [M:0;jenkins-hbase4:43055] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:59,496 INFO [M:0;jenkins-hbase4:43055] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.11 KB heapSize=200.02 KB 2023-02-13 20:03:59,505 INFO [M:0;jenkins-hbase4:43055] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.11 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/da6f406f14f641689631d4db01b10d69 2023-02-13 20:03:59,509 DEBUG [M:0;jenkins-hbase4:43055] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/da6f406f14f641689631d4db01b10d69 as hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/da6f406f14f641689631d4db01b10d69 2023-02-13 20:03:59,512 INFO [M:0;jenkins-hbase4:43055] regionserver.HStore(1080): Added hdfs://localhost:36121/user/jenkins/test-data/40fecd7c-a9cd-f913-1275-f6864d23d3de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/da6f406f14f641689631d4db01b10d69, entries=53, sequenceid=357, filesize=10.7 K 2023-02-13 20:03:59,513 INFO [M:0;jenkins-hbase4:43055] regionserver.HRegion(2947): Finished flush of dataSize ~167.11 KB/171119, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false 2023-02-13 20:03:59,513 INFO [M:0;jenkins-hbase4:43055] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:03:59,514 DEBUG [M:0;jenkins-hbase4:43055] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318639496Disabling compacts and flushes for region at 1676318639496Disabling writes for close at 1676318639496Obtaining lock to block concurrent updates at 1676318639496Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676318639496Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171119, getHeapSize=204800, getOffHeapSize=0, getCellsCount=442 at 1676318639496Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676318639497 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676318639498 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676318639500 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676318639500Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676318639510 (+10 ms)Finished flush of dataSize ~167.11 KB/171119, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false at 1676318639513 (+3 ms)Writing region close event to WAL at 1676318639513Closed at 1676318639513 2023-02-13 20:03:59,516 INFO [M:0;jenkins-hbase4:43055] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 20:03:59,516 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:03:59,517 INFO [M:0;jenkins-hbase4:43055] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43055 2023-02-13 20:03:59,520 DEBUG [M:0;jenkins-hbase4:43055] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43055,1676318632997 already deleted, retry=false 2023-02-13 20:03:59,768 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:59,768 INFO [M:0;jenkins-hbase4:43055] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43055,1676318632997; zookeeper connection closed. 2023-02-13 20:03:59,768 ERROR [Listener at localhost/37999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@e95ac78 rejected from java.util.concurrent.ThreadPoolExecutor@aaa3972[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:59,769 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): master:43055-0x1004f4855d20000, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:59,769 ERROR [Listener at localhost/37999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5df83ff6 rejected from java.util.concurrent.ThreadPoolExecutor@aaa3972[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:59,868 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:59,868 INFO [RS:1;jenkins-hbase4:35987] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35987,1676318633072; zookeeper connection closed. 2023-02-13 20:03:59,868 ERROR [Listener at localhost/37999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50ab2134 rejected from java.util.concurrent.ThreadPoolExecutor@31b839d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:59,868 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35987-0x1004f4855d20002, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:59,868 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6f83bb59] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6f83bb59 2023-02-13 20:03:59,868 ERROR [Listener at localhost/37999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@28cddf9b rejected from java.util.concurrent.ThreadPoolExecutor@31b839d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:59,968 INFO [RS:0;jenkins-hbase4:35759] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35759,1676318633044; zookeeper connection closed. 2023-02-13 20:03:59,968 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:59,968 ERROR [Listener at localhost/37999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@19e04296 rejected from java.util.concurrent.ThreadPoolExecutor@1a1da01e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:59,968 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@22eadf24] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@22eadf24 2023-02-13 20:03:59,969 DEBUG [Listener at localhost/37999-EventThread] zookeeper.ZKWatcher(600): regionserver:35759-0x1004f4855d20001, quorum=127.0.0.1:56374, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:03:59,969 ERROR [Listener at localhost/37999-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@272f99c4 rejected from java.util.concurrent.ThreadPoolExecutor@1a1da01e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:03:59,969 INFO [Listener at localhost/37999] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 20:03:59,970 WARN [Listener at localhost/37999] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:03:59,978 INFO [Listener at localhost/37999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:04:00,083 WARN [BP-1481747856-172.31.14.131-1676318632372 heartbeating to localhost/127.0.0.1:36121] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 20:04:00,083 WARN [BP-1481747856-172.31.14.131-1676318632372 heartbeating to localhost/127.0.0.1:36121] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1481747856-172.31.14.131-1676318632372 (Datanode Uuid 5a9f0f80-a2cf-454c-954e-14a9d831c616) service to localhost/127.0.0.1:36121 2023-02-13 20:04:00,084 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/cluster_b33b9088-86d3-ec37-fffd-219cb83507c7/dfs/data/data3/current/BP-1481747856-172.31.14.131-1676318632372] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:00,084 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/cluster_b33b9088-86d3-ec37-fffd-219cb83507c7/dfs/data/data4/current/BP-1481747856-172.31.14.131-1676318632372] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:00,090 WARN [Listener at localhost/37999] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:04:00,097 INFO [Listener at localhost/37999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:04:00,207 WARN [BP-1481747856-172.31.14.131-1676318632372 heartbeating to localhost/127.0.0.1:36121] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 20:04:00,207 WARN [BP-1481747856-172.31.14.131-1676318632372 heartbeating to localhost/127.0.0.1:36121] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1481747856-172.31.14.131-1676318632372 (Datanode Uuid cc3e1ef8-df74-4bba-8b57-932753adb0ea) service to localhost/127.0.0.1:36121 2023-02-13 20:04:00,208 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/cluster_b33b9088-86d3-ec37-fffd-219cb83507c7/dfs/data/data1/current/BP-1481747856-172.31.14.131-1676318632372] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:00,208 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/cluster_b33b9088-86d3-ec37-fffd-219cb83507c7/dfs/data/data2/current/BP-1481747856-172.31.14.131-1676318632372] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:00,220 INFO [Listener at localhost/37999] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:04:00,272 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 20:04:00,349 INFO [Listener at localhost/37999] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 20:04:00,387 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 20:04:00,408 INFO [Listener at localhost/37999] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=228 (was 178) Potentially hanging thread: Listener at localhost/37999 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:36121 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37999.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/37999.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:36121 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:36121 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/37999.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36121 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37999.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: (jenkins-hbase4.apache.org,43055,1676318632997)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37999.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:36121 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37999.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:36121 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/37999.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37999.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:36121 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37999.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-3-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Listener at localhost/37999.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=637 (was 567) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=313 (was 262) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=1488 (was 1645) 2023-02-13 20:04:00,422 INFO [Listener at localhost/37999] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=228, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=166, AvailableMemoryMB=1487 2023-02-13 20:04:00,432 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/hadoop.log.dir so I do NOT create it in target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1 2023-02-13 20:04:00,432 WARN [Listener at localhost/37999] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 20:04:00,432 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/hadoop.tmp.dir so I do NOT create it in target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1 2023-02-13 20:04:00,432 WARN [Listener at localhost/37999] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1715b3b3-b850-f8c8-4325-ff81142e45f1/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 20:04:00,432 DEBUG [Listener at localhost/37999] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1 2023-02-13 20:04:00,432 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 20:04:00,432 INFO [Listener at localhost/37999] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/cluster_4d5bbd10-da0b-4cfc-85c6-36441593fae3, deleteOnExit=true 2023-02-13 20:04:00,432 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 20:04:00,433 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/test.cache.data in system properties and HBase conf 2023-02-13 20:04:00,433 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 20:04:00,433 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/hadoop.log.dir in system properties and HBase conf 2023-02-13 20:04:00,433 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 20:04:00,433 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 20:04:00,433 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 20:04:00,433 DEBUG [Listener at localhost/37999] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 20:04:00,433 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:04:00,434 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:04:00,434 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 20:04:00,434 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:04:00,434 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 20:04:00,434 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 20:04:00,434 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:04:00,434 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:04:00,434 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 20:04:00,434 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/nfs.dump.dir in system properties and HBase conf 2023-02-13 20:04:00,434 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/java.io.tmpdir in system properties and HBase conf 2023-02-13 20:04:00,434 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:04:00,434 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 20:04:00,435 INFO [Listener at localhost/37999] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 20:04:00,439 WARN [Listener at localhost/37999] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:04:00,439 WARN [Listener at localhost/37999] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:04:00,479 WARN [Listener at localhost/37999] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:04:00,482 INFO [Listener at localhost/37999] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:04:00,487 INFO [Listener at localhost/37999] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/java.io.tmpdir/Jetty_localhost_41679_hdfs____2sc2p1/webapp 2023-02-13 20:04:00,580 INFO [Listener at localhost/37999] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41679 2023-02-13 20:04:00,614 WARN [Listener at localhost/37999] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:04:00,614 WARN [Listener at localhost/37999] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:04:00,655 WARN [Listener at localhost/33453] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:04:00,671 WARN [Listener at localhost/33453] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:04:00,674 WARN [Listener at localhost/33453] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:04:00,676 INFO [Listener at localhost/33453] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:04:00,680 INFO [Listener at localhost/33453] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/java.io.tmpdir/Jetty_localhost_39851_datanode____.3gndrf/webapp 2023-02-13 20:04:00,772 INFO [Listener at localhost/33453] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39851 2023-02-13 20:04:00,781 WARN [Listener at localhost/34215] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:04:00,808 WARN [Listener at localhost/34215] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:04:00,810 WARN [Listener at localhost/34215] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:04:00,811 INFO [Listener at localhost/34215] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:04:00,815 INFO [Listener at localhost/34215] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/java.io.tmpdir/Jetty_localhost_43579_datanode____a9sstb/webapp 2023-02-13 20:04:00,891 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x268907b484e73bfb: Processing first storage report for DS-a37e945f-4369-41dd-9002-f53b6ef3fa33 from datanode 4b81c816-5bbc-445d-8974-7966f2cea4cc 2023-02-13 20:04:00,891 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x268907b484e73bfb: from storage DS-a37e945f-4369-41dd-9002-f53b6ef3fa33 node DatanodeRegistration(127.0.0.1:37193, datanodeUuid=4b81c816-5bbc-445d-8974-7966f2cea4cc, infoPort=40675, infoSecurePort=0, ipcPort=34215, storageInfo=lv=-57;cid=testClusterID;nsid=1077484271;c=1676318640441), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:04:00,891 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x268907b484e73bfb: Processing first storage report for DS-323658d1-9c5c-4ae9-ae5a-61ea10d3923b from datanode 4b81c816-5bbc-445d-8974-7966f2cea4cc 2023-02-13 20:04:00,891 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x268907b484e73bfb: from storage DS-323658d1-9c5c-4ae9-ae5a-61ea10d3923b node DatanodeRegistration(127.0.0.1:37193, datanodeUuid=4b81c816-5bbc-445d-8974-7966f2cea4cc, infoPort=40675, infoSecurePort=0, ipcPort=34215, storageInfo=lv=-57;cid=testClusterID;nsid=1077484271;c=1676318640441), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:04:00,931 INFO [Listener at localhost/34215] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43579 2023-02-13 20:04:00,940 WARN [Listener at localhost/35657] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:04:01,052 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x40e30131bc26e6e: Processing first storage report for DS-75af3230-2be9-4f63-822f-25a9527e9f5c from datanode b62556e5-e0be-4cff-8278-74cbb093f77f 2023-02-13 20:04:01,053 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x40e30131bc26e6e: from storage DS-75af3230-2be9-4f63-822f-25a9527e9f5c node DatanodeRegistration(127.0.0.1:43451, datanodeUuid=b62556e5-e0be-4cff-8278-74cbb093f77f, infoPort=44745, infoSecurePort=0, ipcPort=35657, storageInfo=lv=-57;cid=testClusterID;nsid=1077484271;c=1676318640441), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-13 20:04:01,053 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x40e30131bc26e6e: Processing first storage report for DS-fc757167-ac21-48b2-af13-b91207d7553c from datanode b62556e5-e0be-4cff-8278-74cbb093f77f 2023-02-13 20:04:01,053 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x40e30131bc26e6e: from storage DS-fc757167-ac21-48b2-af13-b91207d7553c node DatanodeRegistration(127.0.0.1:43451, datanodeUuid=b62556e5-e0be-4cff-8278-74cbb093f77f, infoPort=44745, infoSecurePort=0, ipcPort=35657, storageInfo=lv=-57;cid=testClusterID;nsid=1077484271;c=1676318640441), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:04:01,055 DEBUG [Listener at localhost/35657] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1 2023-02-13 20:04:01,057 INFO [Listener at localhost/35657] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/cluster_4d5bbd10-da0b-4cfc-85c6-36441593fae3/zookeeper_0, clientPort=54848, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/cluster_4d5bbd10-da0b-4cfc-85c6-36441593fae3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/cluster_4d5bbd10-da0b-4cfc-85c6-36441593fae3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 20:04:01,058 INFO [Listener at localhost/35657] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54848 2023-02-13 20:04:01,058 INFO [Listener at localhost/35657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:01,060 INFO [Listener at localhost/35657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:01,074 INFO [Listener at localhost/35657] util.FSUtils(479): Created version file at hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a with version=8 2023-02-13 20:04:01,075 INFO [Listener at localhost/35657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:01,076 INFO [Listener at localhost/35657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:01,077 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33453/user/jenkins/test-data/873504cc-e17a-efdd-e983-13045ba9ed45/hbase-staging 2023-02-13 20:04:01,079 INFO [Listener at localhost/35657] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:04:01,079 INFO [Listener at localhost/35657] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:01,079 INFO [Listener at localhost/35657] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:01,079 INFO [Listener at localhost/35657] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:04:01,079 INFO [Listener at localhost/35657] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:01,079 INFO [Listener at localhost/35657] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:04:01,079 INFO [Listener at localhost/35657] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:04:01,080 INFO [Listener at localhost/35657] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33989 2023-02-13 20:04:01,080 INFO [Listener at localhost/35657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:01,081 INFO [Listener at localhost/35657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:01,082 INFO [Listener at localhost/35657] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33989 connecting to ZooKeeper ensemble=127.0.0.1:54848 2023-02-13 20:04:01,095 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:339890x0, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:04:01,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33989-0x1004f4875650000 connected 2023-02-13 20:04:01,113 DEBUG [Listener at localhost/35657] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:04:01,114 DEBUG [Listener at localhost/35657] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:01,114 DEBUG [Listener at localhost/35657] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:04:01,116 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33989 2023-02-13 20:04:01,120 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33989 2023-02-13 20:04:01,120 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33989 2023-02-13 20:04:01,120 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33989 2023-02-13 20:04:01,121 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33989 2023-02-13 20:04:01,121 INFO [Listener at localhost/35657] master.HMaster(439): hbase.rootdir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a, hbase.cluster.distributed=false 2023-02-13 20:04:01,133 INFO [Listener at localhost/35657] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:04:01,133 INFO [Listener at localhost/35657] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:01,133 INFO [Listener at localhost/35657] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:01,133 INFO [Listener at localhost/35657] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:04:01,133 INFO [Listener at localhost/35657] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:01,133 INFO [Listener at localhost/35657] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:04:01,133 INFO [Listener at localhost/35657] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:04:01,134 INFO [Listener at localhost/35657] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37245 2023-02-13 20:04:01,134 INFO [Listener at localhost/35657] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:04:01,139 DEBUG [Listener at localhost/35657] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:04:01,140 INFO [Listener at localhost/35657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:01,141 INFO [Listener at localhost/35657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:01,142 INFO [Listener at localhost/35657] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37245 connecting to ZooKeeper ensemble=127.0.0.1:54848 2023-02-13 20:04:01,146 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:372450x0, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:04:01,147 DEBUG [Listener at localhost/35657] zookeeper.ZKUtil(164): regionserver:372450x0, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:04:01,148 DEBUG [Listener at localhost/35657] zookeeper.ZKUtil(164): regionserver:372450x0, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:01,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37245-0x1004f4875650001 connected 2023-02-13 20:04:01,149 DEBUG [Listener at localhost/35657] zookeeper.ZKUtil(164): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:04:01,156 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37245 2023-02-13 20:04:01,156 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37245 2023-02-13 20:04:01,156 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37245 2023-02-13 20:04:01,157 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37245 2023-02-13 20:04:01,160 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37245 2023-02-13 20:04:01,171 INFO [Listener at localhost/35657] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:04:01,171 INFO [Listener at localhost/35657] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:01,171 INFO [Listener at localhost/35657] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:01,171 INFO [Listener at localhost/35657] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:04:01,171 INFO [Listener at localhost/35657] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:01,171 INFO [Listener at localhost/35657] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:04:01,171 INFO [Listener at localhost/35657] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:04:01,172 INFO [Listener at localhost/35657] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34263 2023-02-13 20:04:01,172 INFO [Listener at localhost/35657] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:04:01,173 DEBUG [Listener at localhost/35657] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:04:01,173 INFO [Listener at localhost/35657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:01,174 INFO [Listener at localhost/35657] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:01,175 INFO [Listener at localhost/35657] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34263 connecting to ZooKeeper ensemble=127.0.0.1:54848 2023-02-13 20:04:01,179 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:342630x0, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:04:01,180 DEBUG [Listener at localhost/35657] zookeeper.ZKUtil(164): regionserver:342630x0, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:04:01,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34263-0x1004f4875650002 connected 2023-02-13 20:04:01,181 DEBUG [Listener at localhost/35657] zookeeper.ZKUtil(164): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:01,181 DEBUG [Listener at localhost/35657] zookeeper.ZKUtil(164): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:04:01,184 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34263 2023-02-13 20:04:01,186 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34263 2023-02-13 20:04:01,186 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34263 2023-02-13 20:04:01,186 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34263 2023-02-13 20:04:01,187 DEBUG [Listener at localhost/35657] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34263 2023-02-13 20:04:01,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33989,1676318641078 2023-02-13 20:04:01,190 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:04:01,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33989,1676318641078 2023-02-13 20:04:01,193 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:04:01,193 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:04:01,193 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:04:01,193 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:01,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:04:01,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33989,1676318641078 from backup master directory 2023-02-13 20:04:01,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:04:01,196 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33989,1676318641078 2023-02-13 20:04:01,196 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:04:01,196 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:04:01,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,33989,1676318641078 2023-02-13 20:04:01,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/hbase.id with ID: 222d1fbc-587c-4d96-b497-9a3f539dcef2 2023-02-13 20:04:01,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:01,221 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:01,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0bbef56f to 127.0.0.1:54848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:01,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65e7d29d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:01,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:04:01,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 20:04:01,236 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:04:01,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/MasterData/data/master/store-tmp 2023-02-13 20:04:01,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:01,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:04:01,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:01,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:01,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:04:01,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:01,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:01,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318641245Disabling compacts and flushes for region at 1676318641245Disabling writes for close at 1676318641245Writing region close event to WAL at 1676318641245Closed at 1676318641245 2023-02-13 20:04:01,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/MasterData/WALs/jenkins-hbase4.apache.org,33989,1676318641078 2023-02-13 20:04:01,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33989%2C1676318641078, suffix=, logDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/MasterData/WALs/jenkins-hbase4.apache.org,33989,1676318641078, archiveDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/MasterData/oldWALs, maxLogs=10 2023-02-13 20:04:01,260 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37193,DS-a37e945f-4369-41dd-9002-f53b6ef3fa33,DISK] 2023-02-13 20:04:01,261 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43451,DS-75af3230-2be9-4f63-822f-25a9527e9f5c,DISK] 2023-02-13 20:04:01,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/MasterData/WALs/jenkins-hbase4.apache.org,33989,1676318641078/jenkins-hbase4.apache.org%2C33989%2C1676318641078.1676318641248 2023-02-13 20:04:01,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37193,DS-a37e945f-4369-41dd-9002-f53b6ef3fa33,DISK], DatanodeInfoWithStorage[127.0.0.1:43451,DS-75af3230-2be9-4f63-822f-25a9527e9f5c,DISK]] 2023-02-13 20:04:01,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:04:01,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:01,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:01,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:01,266 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:01,267 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 20:04:01,267 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 20:04:01,267 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:01,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:01,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:01,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:01,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:04:01,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61464564, jitterRate=-0.08410662412643433}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:04:01,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676318641263Initializing all the Stores at 1676318641264 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318641264Cleaning up temporary data from old regions at 1676318641268 (+4 ms)Cleaning up detritus from prior splits at 1676318641269 (+1 ms)Region opened successfully at 1676318641272 (+3 ms) 2023-02-13 20:04:01,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 20:04:01,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 20:04:01,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 20:04:01,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 20:04:01,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 20:04:01,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 20:04:01,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 20:04:01,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 20:04:01,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 20:04:01,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 20:04:01,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 20:04:01,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 20:04:01,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 20:04:01,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 20:04:01,290 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:01,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 20:04:01,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 20:04:01,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 20:04:01,293 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:01,293 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:01,293 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:01,293 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:01,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,33989,1676318641078, sessionid=0x1004f4875650000, setting cluster-up flag (Was=false) 2023-02-13 20:04:01,298 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:01,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 20:04:01,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33989,1676318641078 2023-02-13 20:04:01,312 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:01,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 20:04:01,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33989,1676318641078 2023-02-13 20:04:01,317 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.hbase-snapshot/.tmp 2023-02-13 20:04:01,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 20:04:01,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:04:01,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:04:01,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:04:01,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:04:01,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 20:04:01,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:04:01,318 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676318671320 2023-02-13 20:04:01,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 20:04:01,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 20:04:01,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 20:04:01,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 20:04:01,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 20:04:01,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 20:04:01,321 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:04:01,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,321 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 20:04:01,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 20:04:01,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 20:04:01,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 20:04:01,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 20:04:01,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 20:04:01,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318641322,5,FailOnTimeoutGroup] 2023-02-13 20:04:01,322 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:04:01,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318641322,5,FailOnTimeoutGroup] 2023-02-13 20:04:01,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 20:04:01,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,333 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:04:01,334 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:04:01,334 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a 2023-02-13 20:04:01,341 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:01,342 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:04:01,343 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/info 2023-02-13 20:04:01,344 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:04:01,344 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:01,344 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:04:01,345 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:04:01,345 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:04:01,345 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:01,346 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:04:01,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/table 2023-02-13 20:04:01,347 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:04:01,347 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:01,347 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740 2023-02-13 20:04:01,348 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740 2023-02-13 20:04:01,349 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:04:01,350 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:04:01,351 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:04:01,352 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59148849, jitterRate=-0.11861346662044525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:04:01,352 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676318641342Initializing all the Stores at 1676318641342Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318641342Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318641342Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318641342Cleaning up temporary data from old regions at 1676318641348 (+6 ms)Cleaning up detritus from prior splits at 1676318641349 (+1 ms)Region opened successfully at 1676318641352 (+3 ms) 2023-02-13 20:04:01,352 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:04:01,352 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:04:01,352 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:04:01,352 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:04:01,352 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:04:01,352 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:04:01,352 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318641352Disabling compacts and flushes for region at 1676318641352Disabling writes for close at 1676318641352Writing region close event to WAL at 1676318641352Closed at 1676318641352 2023-02-13 20:04:01,353 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:04:01,353 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 20:04:01,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 20:04:01,354 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 20:04:01,356 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 20:04:01,390 INFO [RS:0;jenkins-hbase4:37245] regionserver.HRegionServer(952): ClusterId : 222d1fbc-587c-4d96-b497-9a3f539dcef2 2023-02-13 20:04:01,390 INFO [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(952): ClusterId : 222d1fbc-587c-4d96-b497-9a3f539dcef2 2023-02-13 20:04:01,390 DEBUG [RS:0;jenkins-hbase4:37245] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:04:01,390 DEBUG [RS:1;jenkins-hbase4:34263] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:04:01,393 DEBUG [RS:1;jenkins-hbase4:34263] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:04:01,393 DEBUG [RS:1;jenkins-hbase4:34263] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:04:01,393 DEBUG [RS:0;jenkins-hbase4:37245] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:04:01,393 DEBUG [RS:0;jenkins-hbase4:37245] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:04:01,395 DEBUG [RS:1;jenkins-hbase4:34263] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:04:01,397 DEBUG [RS:1;jenkins-hbase4:34263] zookeeper.ReadOnlyZKClient(139): Connect 0x413e0b63 to 127.0.0.1:54848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:01,397 DEBUG [RS:0;jenkins-hbase4:37245] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:04:01,398 DEBUG [RS:0;jenkins-hbase4:37245] zookeeper.ReadOnlyZKClient(139): Connect 0x2d995b2d to 127.0.0.1:54848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:01,406 DEBUG [RS:1;jenkins-hbase4:34263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ff9fd34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:01,406 DEBUG [RS:0;jenkins-hbase4:37245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@235eb0ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:01,406 DEBUG [RS:1;jenkins-hbase4:34263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bc66013, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:04:01,406 DEBUG [RS:0;jenkins-hbase4:37245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2761305d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:04:01,415 DEBUG [RS:1;jenkins-hbase4:34263] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34263 2023-02-13 20:04:01,415 DEBUG [RS:0;jenkins-hbase4:37245] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37245 2023-02-13 20:04:01,415 INFO [RS:1;jenkins-hbase4:34263] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:04:01,415 INFO [RS:0;jenkins-hbase4:37245] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:04:01,415 INFO [RS:0;jenkins-hbase4:37245] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:04:01,415 INFO [RS:1;jenkins-hbase4:34263] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:04:01,415 DEBUG [RS:0;jenkins-hbase4:37245] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:04:01,415 DEBUG [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:04:01,416 INFO [RS:0;jenkins-hbase4:37245] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33989,1676318641078 with isa=jenkins-hbase4.apache.org/172.31.14.131:37245, startcode=1676318641132 2023-02-13 20:04:01,416 INFO [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33989,1676318641078 with isa=jenkins-hbase4.apache.org/172.31.14.131:34263, startcode=1676318641170 2023-02-13 20:04:01,416 DEBUG [RS:0;jenkins-hbase4:37245] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:04:01,416 DEBUG [RS:1;jenkins-hbase4:34263] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:04:01,417 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33773, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:04:01,418 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33083, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:04:01,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33989] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:01,419 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:01,420 DEBUG [RS:0;jenkins-hbase4:37245] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a 2023-02-13 20:04:01,420 DEBUG [RS:0;jenkins-hbase4:37245] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33453 2023-02-13 20:04:01,420 DEBUG [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a 2023-02-13 20:04:01,420 DEBUG [RS:0;jenkins-hbase4:37245] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:04:01,420 DEBUG [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:33453 2023-02-13 20:04:01,420 DEBUG [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:04:01,426 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:01,426 DEBUG [RS:0;jenkins-hbase4:37245] zookeeper.ZKUtil(162): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:01,426 DEBUG [RS:1;jenkins-hbase4:34263] zookeeper.ZKUtil(162): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:01,427 WARN [RS:0;jenkins-hbase4:37245] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:04:01,427 WARN [RS:1;jenkins-hbase4:34263] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:04:01,427 INFO [RS:0;jenkins-hbase4:37245] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:04:01,427 INFO [RS:1;jenkins-hbase4:34263] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:04:01,427 DEBUG [RS:0;jenkins-hbase4:37245] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/WALs/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:01,427 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37245,1676318641132] 2023-02-13 20:04:01,427 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34263,1676318641170] 2023-02-13 20:04:01,427 DEBUG [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(1947): logDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/WALs/jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:01,433 DEBUG [RS:0;jenkins-hbase4:37245] zookeeper.ZKUtil(162): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:01,433 DEBUG [RS:1;jenkins-hbase4:34263] zookeeper.ZKUtil(162): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:01,433 DEBUG [RS:0;jenkins-hbase4:37245] zookeeper.ZKUtil(162): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:01,433 DEBUG [RS:1;jenkins-hbase4:34263] zookeeper.ZKUtil(162): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:01,434 DEBUG [RS:0;jenkins-hbase4:37245] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:04:01,434 DEBUG [RS:1;jenkins-hbase4:34263] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:04:01,434 INFO [RS:1;jenkins-hbase4:34263] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:04:01,434 INFO [RS:0;jenkins-hbase4:37245] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:04:01,435 INFO [RS:1;jenkins-hbase4:34263] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:04:01,435 INFO [RS:1;jenkins-hbase4:34263] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:04:01,435 INFO [RS:1;jenkins-hbase4:34263] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,435 INFO [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:04:01,437 INFO [RS:1;jenkins-hbase4:34263] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,441 INFO [RS:0;jenkins-hbase4:37245] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:04:01,441 DEBUG [RS:1;jenkins-hbase4:34263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,441 DEBUG [RS:1;jenkins-hbase4:34263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,441 DEBUG [RS:1;jenkins-hbase4:34263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,441 DEBUG [RS:1;jenkins-hbase4:34263] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,441 INFO [RS:0;jenkins-hbase4:37245] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:04:01,441 DEBUG [RS:1;jenkins-hbase4:34263] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,441 INFO [RS:0;jenkins-hbase4:37245] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,441 DEBUG [RS:1;jenkins-hbase4:34263] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:04:01,441 DEBUG [RS:1;jenkins-hbase4:34263] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,441 INFO [RS:0;jenkins-hbase4:37245] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:04:01,442 DEBUG [RS:1;jenkins-hbase4:34263] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,442 DEBUG [RS:1;jenkins-hbase4:34263] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,442 DEBUG [RS:1;jenkins-hbase4:34263] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,442 INFO [RS:1;jenkins-hbase4:34263] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,443 INFO [RS:0;jenkins-hbase4:37245] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,443 INFO [RS:1;jenkins-hbase4:34263] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,444 DEBUG [RS:0;jenkins-hbase4:37245] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,444 INFO [RS:1;jenkins-hbase4:34263] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,444 DEBUG [RS:0;jenkins-hbase4:37245] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,444 DEBUG [RS:0;jenkins-hbase4:37245] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,444 DEBUG [RS:0;jenkins-hbase4:37245] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,444 DEBUG [RS:0;jenkins-hbase4:37245] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,444 DEBUG [RS:0;jenkins-hbase4:37245] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:04:01,444 DEBUG [RS:0;jenkins-hbase4:37245] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,444 DEBUG [RS:0;jenkins-hbase4:37245] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,444 DEBUG [RS:0;jenkins-hbase4:37245] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,444 DEBUG [RS:0;jenkins-hbase4:37245] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:01,449 INFO [RS:0;jenkins-hbase4:37245] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,449 INFO [RS:0;jenkins-hbase4:37245] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,449 INFO [RS:0;jenkins-hbase4:37245] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,460 INFO [RS:1;jenkins-hbase4:34263] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:04:01,460 INFO [RS:0;jenkins-hbase4:37245] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:04:01,460 INFO [RS:1;jenkins-hbase4:34263] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34263,1676318641170-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,460 INFO [RS:0;jenkins-hbase4:37245] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37245,1676318641132-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,475 INFO [RS:0;jenkins-hbase4:37245] regionserver.Replication(203): jenkins-hbase4.apache.org,37245,1676318641132 started 2023-02-13 20:04:01,475 INFO [RS:1;jenkins-hbase4:34263] regionserver.Replication(203): jenkins-hbase4.apache.org,34263,1676318641170 started 2023-02-13 20:04:01,475 INFO [RS:0;jenkins-hbase4:37245] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37245,1676318641132, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37245, sessionid=0x1004f4875650001 2023-02-13 20:04:01,475 INFO [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34263,1676318641170, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34263, sessionid=0x1004f4875650002 2023-02-13 20:04:01,475 DEBUG [RS:0;jenkins-hbase4:37245] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:04:01,475 DEBUG [RS:1;jenkins-hbase4:34263] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:04:01,475 DEBUG [RS:1;jenkins-hbase4:34263] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:01,475 DEBUG [RS:1;jenkins-hbase4:34263] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34263,1676318641170' 2023-02-13 20:04:01,475 DEBUG [RS:1;jenkins-hbase4:34263] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:01,475 DEBUG [RS:0;jenkins-hbase4:37245] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:01,475 DEBUG [RS:0;jenkins-hbase4:37245] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37245,1676318641132' 2023-02-13 20:04:01,475 DEBUG [RS:0;jenkins-hbase4:37245] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:01,476 DEBUG [RS:0;jenkins-hbase4:37245] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:01,476 DEBUG [RS:1;jenkins-hbase4:34263] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:01,476 DEBUG [RS:0;jenkins-hbase4:37245] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:04:01,476 DEBUG [RS:0;jenkins-hbase4:37245] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:04:01,476 DEBUG [RS:1;jenkins-hbase4:34263] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:04:01,476 DEBUG [RS:1;jenkins-hbase4:34263] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:04:01,476 DEBUG [RS:1;jenkins-hbase4:34263] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:01,476 DEBUG [RS:1;jenkins-hbase4:34263] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34263,1676318641170' 2023-02-13 20:04:01,476 DEBUG [RS:1;jenkins-hbase4:34263] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:01,476 DEBUG [RS:0;jenkins-hbase4:37245] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:01,476 DEBUG [RS:0;jenkins-hbase4:37245] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37245,1676318641132' 2023-02-13 20:04:01,476 DEBUG [RS:0;jenkins-hbase4:37245] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:01,477 DEBUG [RS:1;jenkins-hbase4:34263] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:01,477 DEBUG [RS:0;jenkins-hbase4:37245] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:01,477 DEBUG [RS:1;jenkins-hbase4:34263] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:04:01,477 INFO [RS:1;jenkins-hbase4:34263] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:04:01,477 INFO [RS:1;jenkins-hbase4:34263] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:04:01,477 DEBUG [RS:0;jenkins-hbase4:37245] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:04:01,477 INFO [RS:0;jenkins-hbase4:37245] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:04:01,477 INFO [RS:0;jenkins-hbase4:37245] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:04:01,506 DEBUG [jenkins-hbase4:33989] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 20:04:01,506 DEBUG [jenkins-hbase4:33989] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:04:01,507 DEBUG [jenkins-hbase4:33989] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:04:01,507 DEBUG [jenkins-hbase4:33989] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:04:01,507 DEBUG [jenkins-hbase4:33989] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:04:01,508 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34263,1676318641170, state=OPENING 2023-02-13 20:04:01,509 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 20:04:01,510 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:01,510 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:04:01,513 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34263,1676318641170}] 2023-02-13 20:04:01,668 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:01,668 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 20:04:01,670 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52684, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 20:04:01,673 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 20:04:01,673 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:04:01,674 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34263%2C1676318641170.meta, suffix=.meta, logDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/WALs/jenkins-hbase4.apache.org,34263,1676318641170, archiveDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/oldWALs, maxLogs=32 2023-02-13 20:04:01,687 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43451,DS-75af3230-2be9-4f63-822f-25a9527e9f5c,DISK] 2023-02-13 20:04:01,687 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37193,DS-a37e945f-4369-41dd-9002-f53b6ef3fa33,DISK] 2023-02-13 20:04:01,689 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/WALs/jenkins-hbase4.apache.org,34263,1676318641170/jenkins-hbase4.apache.org%2C34263%2C1676318641170.meta.1676318641675.meta 2023-02-13 20:04:01,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37193,DS-a37e945f-4369-41dd-9002-f53b6ef3fa33,DISK], DatanodeInfoWithStorage[127.0.0.1:43451,DS-75af3230-2be9-4f63-822f-25a9527e9f5c,DISK]] 2023-02-13 20:04:01,689 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:04:01,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 20:04:01,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 20:04:01,690 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 20:04:01,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 20:04:01,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:01,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 20:04:01,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 20:04:01,691 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:04:01,692 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/info 2023-02-13 20:04:01,692 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/info 2023-02-13 20:04:01,692 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:04:01,693 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:01,693 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:04:01,693 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:04:01,693 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:04:01,694 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:04:01,694 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:01,694 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:04:01,695 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/table 2023-02-13 20:04:01,695 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/table 2023-02-13 20:04:01,695 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:04:01,695 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:01,696 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740 2023-02-13 20:04:01,697 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740 2023-02-13 20:04:01,698 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:04:01,699 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:04:01,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74435901, jitterRate=0.10918135941028595}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:04:01,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676318641690Writing region info on filesystem at 1676318641690Initializing all the Stores at 1676318641691 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318641691Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318641691Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318641691Cleaning up temporary data from old regions at 1676318641698 (+7 ms)Cleaning up detritus from prior splits at 1676318641698Running coprocessor post-open hooks at 1676318641700 (+2 ms)Region opened successfully at 1676318641700 2023-02-13 20:04:01,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676318641668 2023-02-13 20:04:01,704 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 20:04:01,704 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 20:04:01,704 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34263,1676318641170, state=OPEN 2023-02-13 20:04:01,706 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 20:04:01,706 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:04:01,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 20:04:01,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34263,1676318641170 in 196 msec 2023-02-13 20:04:01,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 20:04:01,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 354 msec 2023-02-13 20:04:01,709 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 391 msec 2023-02-13 20:04:01,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676318641191, completionTime=-1 2023-02-13 20:04:01,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 20:04:01,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 20:04:01,712 DEBUG [hconnection-0x6184e6b4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:04:01,713 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52692, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:04:01,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 20:04:01,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676318701714 2023-02-13 20:04:01,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676318761714 2023-02-13 20:04:01,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-13 20:04:01,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33989,1676318641078-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33989,1676318641078-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33989,1676318641078-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33989, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:01,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 20:04:01,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:04:01,723 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 20:04:01,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 20:04:01,729 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:04:01,729 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:04:01,731 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/hbase/namespace/46d99b8ce0368f5cb0af5a91df59ba99 2023-02-13 20:04:01,731 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/hbase/namespace/46d99b8ce0368f5cb0af5a91df59ba99 empty. 2023-02-13 20:04:01,731 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/hbase/namespace/46d99b8ce0368f5cb0af5a91df59ba99 2023-02-13 20:04:01,731 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 20:04:01,739 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 20:04:01,740 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 46d99b8ce0368f5cb0af5a91df59ba99, NAME => 'hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp 2023-02-13 20:04:01,750 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:01,750 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 46d99b8ce0368f5cb0af5a91df59ba99, disabling compactions & flushes 2023-02-13 20:04:01,750 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. 2023-02-13 20:04:01,750 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. 2023-02-13 20:04:01,750 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. after waiting 0 ms 2023-02-13 20:04:01,750 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. 2023-02-13 20:04:01,750 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. 2023-02-13 20:04:01,750 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 46d99b8ce0368f5cb0af5a91df59ba99: Waiting for close lock at 1676318641750Disabling compacts and flushes for region at 1676318641750Disabling writes for close at 1676318641750Writing region close event to WAL at 1676318641750Closed at 1676318641750 2023-02-13 20:04:01,752 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:04:01,753 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318641752"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318641752"}]},"ts":"1676318641752"} 2023-02-13 20:04:01,755 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 20:04:01,756 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:04:01,756 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318641756"}]},"ts":"1676318641756"} 2023-02-13 20:04:01,757 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 20:04:01,760 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:04:01,761 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:04:01,761 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:04:01,761 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:04:01,761 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=46d99b8ce0368f5cb0af5a91df59ba99, ASSIGN}] 2023-02-13 20:04:01,763 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=46d99b8ce0368f5cb0af5a91df59ba99, ASSIGN 2023-02-13 20:04:01,764 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=46d99b8ce0368f5cb0af5a91df59ba99, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34263,1676318641170; forceNewPlan=false, retain=false 2023-02-13 20:04:01,914 INFO [jenkins-hbase4:33989] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 20:04:01,915 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=46d99b8ce0368f5cb0af5a91df59ba99, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:01,915 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318641915"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318641915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318641915"}]},"ts":"1676318641915"} 2023-02-13 20:04:01,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 46d99b8ce0368f5cb0af5a91df59ba99, server=jenkins-hbase4.apache.org,34263,1676318641170}] 2023-02-13 20:04:02,071 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. 2023-02-13 20:04:02,072 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34263%2C1676318641170, suffix=, logDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/WALs/jenkins-hbase4.apache.org,34263,1676318641170, archiveDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/oldWALs, maxLogs=32 2023-02-13 20:04:02,084 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43451,DS-75af3230-2be9-4f63-822f-25a9527e9f5c,DISK] 2023-02-13 20:04:02,084 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37193,DS-a37e945f-4369-41dd-9002-f53b6ef3fa33,DISK] 2023-02-13 20:04:02,086 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/WALs/jenkins-hbase4.apache.org,34263,1676318641170/jenkins-hbase4.apache.org%2C34263%2C1676318641170.1676318642073 2023-02-13 20:04:02,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37193,DS-a37e945f-4369-41dd-9002-f53b6ef3fa33,DISK], DatanodeInfoWithStorage[127.0.0.1:43451,DS-75af3230-2be9-4f63-822f-25a9527e9f5c,DISK]] 2023-02-13 20:04:02,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 46d99b8ce0368f5cb0af5a91df59ba99, NAME => 'hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:04:02,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 46d99b8ce0368f5cb0af5a91df59ba99 2023-02-13 20:04:02,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:02,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 46d99b8ce0368f5cb0af5a91df59ba99 2023-02-13 20:04:02,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 46d99b8ce0368f5cb0af5a91df59ba99 2023-02-13 20:04:02,088 INFO [StoreOpener-46d99b8ce0368f5cb0af5a91df59ba99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 46d99b8ce0368f5cb0af5a91df59ba99 2023-02-13 20:04:02,089 DEBUG [StoreOpener-46d99b8ce0368f5cb0af5a91df59ba99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/namespace/46d99b8ce0368f5cb0af5a91df59ba99/info 2023-02-13 20:04:02,089 DEBUG [StoreOpener-46d99b8ce0368f5cb0af5a91df59ba99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/namespace/46d99b8ce0368f5cb0af5a91df59ba99/info 2023-02-13 20:04:02,089 INFO [StoreOpener-46d99b8ce0368f5cb0af5a91df59ba99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46d99b8ce0368f5cb0af5a91df59ba99 columnFamilyName info 2023-02-13 20:04:02,090 INFO [StoreOpener-46d99b8ce0368f5cb0af5a91df59ba99-1] regionserver.HStore(310): Store=46d99b8ce0368f5cb0af5a91df59ba99/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:02,090 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/namespace/46d99b8ce0368f5cb0af5a91df59ba99 2023-02-13 20:04:02,090 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/namespace/46d99b8ce0368f5cb0af5a91df59ba99 2023-02-13 20:04:02,092 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 46d99b8ce0368f5cb0af5a91df59ba99 2023-02-13 20:04:02,094 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/namespace/46d99b8ce0368f5cb0af5a91df59ba99/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:04:02,094 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 46d99b8ce0368f5cb0af5a91df59ba99; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66184873, jitterRate=-0.01376853883266449}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:04:02,094 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 46d99b8ce0368f5cb0af5a91df59ba99: Running coprocessor pre-open hook at 1676318642087Writing region info on filesystem at 1676318642087Initializing all the Stores at 1676318642087Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318642087Cleaning up temporary data from old regions at 1676318642091 (+4 ms)Cleaning up detritus from prior splits at 1676318642091Running coprocessor post-open hooks at 1676318642094 (+3 ms)Region opened successfully at 1676318642094 2023-02-13 20:04:02,095 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99., pid=6, masterSystemTime=1676318642068 2023-02-13 20:04:02,097 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. 2023-02-13 20:04:02,097 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. 2023-02-13 20:04:02,097 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=46d99b8ce0368f5cb0af5a91df59ba99, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:02,098 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318642097"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318642097"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318642097"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318642097"}]},"ts":"1676318642097"} 2023-02-13 20:04:02,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 20:04:02,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 46d99b8ce0368f5cb0af5a91df59ba99, server=jenkins-hbase4.apache.org,34263,1676318641170 in 183 msec 2023-02-13 20:04:02,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 20:04:02,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=46d99b8ce0368f5cb0af5a91df59ba99, ASSIGN in 339 msec 2023-02-13 20:04:02,102 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:04:02,102 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318642102"}]},"ts":"1676318642102"} 2023-02-13 20:04:02,103 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 20:04:02,106 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:04:02,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 384 msec 2023-02-13 20:04:02,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 20:04:02,130 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:04:02,130 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:02,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 20:04:02,139 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:04:02,142 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-13 20:04:02,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 20:04:02,151 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:04:02,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-13 20:04:02,157 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 20:04:02,160 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 20:04:02,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.964sec 2023-02-13 20:04:02,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 20:04:02,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 20:04:02,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 20:04:02,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33989,1676318641078-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 20:04:02,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33989,1676318641078-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 20:04:02,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 20:04:02,190 DEBUG [Listener at localhost/35657] zookeeper.ReadOnlyZKClient(139): Connect 0x11a91808 to 127.0.0.1:54848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:02,201 DEBUG [Listener at localhost/35657] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e536700, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:02,202 DEBUG [hconnection-0x6725f5e2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:04:02,204 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52696, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:04:02,205 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33989,1676318641078 2023-02-13 20:04:02,205 DEBUG [Listener at localhost/35657] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 20:04:02,207 DEBUG [Listener at localhost/35657] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 20:04:02,208 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55940, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 20:04:02,209 INFO [Listener at localhost/35657] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,209 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 20:04:02,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:55940 deadline: 1676318702209, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,210 INFO [Listener at localhost/35657] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-13 20:04:02,212 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:04:02,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,214 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:04:02,214 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-13 20:04:02,215 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:04:02,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:04:02,216 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:02,216 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c empty. 2023-02-13 20:04:02,217 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:02,217 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-13 20:04:02,225 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-13 20:04:02,225 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 87bcfad57cedbf37b3917a8d1997198c, NAME => 'testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp 2023-02-13 20:04:02,231 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:02,231 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing 87bcfad57cedbf37b3917a8d1997198c, disabling compactions & flushes 2023-02-13 20:04:02,231 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:02,231 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:02,231 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. after waiting 0 ms 2023-02-13 20:04:02,231 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:02,231 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:02,231 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for 87bcfad57cedbf37b3917a8d1997198c: Waiting for close lock at 1676318642231Disabling compacts and flushes for region at 1676318642231Disabling writes for close at 1676318642231Writing region close event to WAL at 1676318642231Closed at 1676318642231 2023-02-13 20:04:02,233 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:04:02,233 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676318642233"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318642233"}]},"ts":"1676318642233"} 2023-02-13 20:04:02,235 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 20:04:02,235 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:04:02,235 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318642235"}]},"ts":"1676318642235"} 2023-02-13 20:04:02,236 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-13 20:04:02,240 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:04:02,241 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:04:02,241 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:04:02,241 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:04:02,241 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=87bcfad57cedbf37b3917a8d1997198c, ASSIGN}] 2023-02-13 20:04:02,243 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=87bcfad57cedbf37b3917a8d1997198c, ASSIGN 2023-02-13 20:04:02,244 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=87bcfad57cedbf37b3917a8d1997198c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37245,1676318641132; forceNewPlan=false, retain=false 2023-02-13 20:04:02,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:04:02,394 INFO [jenkins-hbase4:33989] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 20:04:02,394 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=87bcfad57cedbf37b3917a8d1997198c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:02,394 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676318642394"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318642394"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318642394"}]},"ts":"1676318642394"} 2023-02-13 20:04:02,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 87bcfad57cedbf37b3917a8d1997198c, server=jenkins-hbase4.apache.org,37245,1676318641132}] 2023-02-13 20:04:02,479 INFO [RS:0;jenkins-hbase4:37245] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37245%2C1676318641132, suffix=, logDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/WALs/jenkins-hbase4.apache.org,37245,1676318641132, archiveDir=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/oldWALs, maxLogs=32 2023-02-13 20:04:02,501 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43451,DS-75af3230-2be9-4f63-822f-25a9527e9f5c,DISK] 2023-02-13 20:04:02,501 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37193,DS-a37e945f-4369-41dd-9002-f53b6ef3fa33,DISK] 2023-02-13 20:04:02,503 INFO [RS:0;jenkins-hbase4:37245] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/WALs/jenkins-hbase4.apache.org,37245,1676318641132/jenkins-hbase4.apache.org%2C37245%2C1676318641132.1676318642479 2023-02-13 20:04:02,503 DEBUG [RS:0;jenkins-hbase4:37245] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37193,DS-a37e945f-4369-41dd-9002-f53b6ef3fa33,DISK], DatanodeInfoWithStorage[127.0.0.1:43451,DS-75af3230-2be9-4f63-822f-25a9527e9f5c,DISK]] 2023-02-13 20:04:02,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:04:02,549 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:02,549 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 20:04:02,550 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42398, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 20:04:02,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:02,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 87bcfad57cedbf37b3917a8d1997198c, NAME => 'testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:04:02,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion 87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:02,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:02,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:02,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:02,555 INFO [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:02,556 DEBUG [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1 2023-02-13 20:04:02,556 DEBUG [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1 2023-02-13 20:04:02,556 INFO [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87bcfad57cedbf37b3917a8d1997198c columnFamilyName f1 2023-02-13 20:04:02,557 INFO [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] regionserver.HStore(310): Store=87bcfad57cedbf37b3917a8d1997198c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:02,557 INFO [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:02,558 DEBUG [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2 2023-02-13 20:04:02,558 DEBUG [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2 2023-02-13 20:04:02,558 INFO [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87bcfad57cedbf37b3917a8d1997198c columnFamilyName f2 2023-02-13 20:04:02,559 INFO [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] regionserver.HStore(310): Store=87bcfad57cedbf37b3917a8d1997198c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:02,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:02,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:02,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:04:02,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:02,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:04:02,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 87bcfad57cedbf37b3917a8d1997198c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68934032, jitterRate=0.02719712257385254}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:04:02,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 87bcfad57cedbf37b3917a8d1997198c: Running coprocessor pre-open hook at 1676318642554Writing region info on filesystem at 1676318642554Initializing all the Stores at 1676318642554Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318642554Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318642554Cleaning up temporary data from old regions at 1676318642560 (+6 ms)Cleaning up detritus from prior splits at 1676318642560Running coprocessor post-open hooks at 1676318642564 (+4 ms)Region opened successfully at 1676318642564 2023-02-13 20:04:02,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c., pid=12, masterSystemTime=1676318642549 2023-02-13 20:04:02,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:02,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:02,571 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=87bcfad57cedbf37b3917a8d1997198c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:02,571 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676318642571"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318642571"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318642571"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318642571"}]},"ts":"1676318642571"} 2023-02-13 20:04:02,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 20:04:02,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 87bcfad57cedbf37b3917a8d1997198c, server=jenkins-hbase4.apache.org,37245,1676318641132 in 176 msec 2023-02-13 20:04:02,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 20:04:02,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=87bcfad57cedbf37b3917a8d1997198c, ASSIGN in 333 msec 2023-02-13 20:04:02,576 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:04:02,576 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318642576"}]},"ts":"1676318642576"} 2023-02-13 20:04:02,577 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-13 20:04:02,579 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:04:02,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 367 msec 2023-02-13 20:04:02,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:04:02,819 INFO [Listener at localhost/35657] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-13 20:04:02,819 DEBUG [Listener at localhost/35657] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-13 20:04:02,819 INFO [Listener at localhost/35657] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:04:02,821 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-13 20:04:02,821 INFO [Listener at localhost/35657] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:04:02,821 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-13 20:04:02,822 INFO [Listener at localhost/35657] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 20:04:02,834 DEBUG [hconnection-0x6725f5e2-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:04:02,846 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42404, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:04:02,852 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37245] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:02,951 INFO [Listener at localhost/35657] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 20:04:02,951 INFO [Listener at localhost/35657] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 20:04:02,953 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 20:04:02,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676318642953 (current time:1676318642953). 2023-02-13 20:04:02,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 20:04:02,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] zookeeper.ReadOnlyZKClient(139): Connect 0x2a4f7f00 to 127.0.0.1:54848 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:02,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10ecc35f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:02,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:04:02,959 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52700, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:04:02,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a4f7f00 to 127.0.0.1:54848 2023-02-13 20:04:02,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:02,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 20:04:02,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 20:04:02,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 20:04:02,963 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 20:04:02,963 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676319242963 2023-02-13 20:04:02,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 20:04:02,964 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,964 DEBUG [Listener at localhost/35657] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 20:04:02,965 DEBUG [Listener at localhost/35657] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 20:04:02,966 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 20:04:02,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 20:04:02,967 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-13 20:04:02,967 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 20:04:02,968 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676319242968 2023-02-13 20:04:02,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,975 INFO [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-13 20:04:02,975 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:04:02,976 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-13 20:04:02,976 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 20:04:02,976 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,976 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,979 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:04:02,979 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:04:02,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:04:02,979 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:02,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:04:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:02,979 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,979 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:04:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-13 20:04:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-13 20:04:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-13 20:04:02,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-13 20:04:02,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,980 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-13 20:04:02,980 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:04:02,980 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-13 20:04:02,981 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:04:02,981 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 20:04:02,982 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 20:04:02,982 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 20:04:02,982 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 20:04:02,982 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34263,1676318641170' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 20:04:02,982 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37245,1676318641132' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 20:04:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,983 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:04:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,984 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:04:02,983 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,984 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:04:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:02,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:02,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:02,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37245,1676318641132' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-13 20:04:02,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a8a01bc[Count = 0] remaining members to acquire global barrier 2023-02-13 20:04:02,985 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 20:04:02,985 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,986 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,986 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,986 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 20:04:02,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:02,986 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 20:04:02,987 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 20:04:02,987 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 20:04:02,987 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 20:04:02,986 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:02,987 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:04:02,987 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:02,987 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34263,1676318641170' in zk 2023-02-13 20:04:02,987 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. started... 2023-02-13 20:04:02,987 INFO [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 87bcfad57cedbf37b3917a8d1997198c 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 20:04:02,988 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 20:04:02,988 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:02,988 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 20:04:03,000 INFO [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/.tmp/f1/9d0c5a846e464ac7b430675cd79e756d 2023-02-13 20:04:03,016 INFO [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/.tmp/f2/3d478ced25cb407b9d6b3350c11dfb60 2023-02-13 20:04:03,021 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/.tmp/f1/9d0c5a846e464ac7b430675cd79e756d as hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1/9d0c5a846e464ac7b430675cd79e756d 2023-02-13 20:04:03,024 INFO [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1/9d0c5a846e464ac7b430675cd79e756d, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 20:04:03,025 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/.tmp/f2/3d478ced25cb407b9d6b3350c11dfb60 as hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2/3d478ced25cb407b9d6b3350c11dfb60 2023-02-13 20:04:03,029 INFO [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2/3d478ced25cb407b9d6b3350c11dfb60, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 20:04:03,030 INFO [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 87bcfad57cedbf37b3917a8d1997198c in 43ms, sequenceid=5, compaction requested=false 2023-02-13 20:04:03,030 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-13 20:04:03,030 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 87bcfad57cedbf37b3917a8d1997198c: 2023-02-13 20:04:03,031 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,031 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:04:03,031 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1/9d0c5a846e464ac7b430675cd79e756d] hfiles 2023-02-13 20:04:03,031 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1/9d0c5a846e464ac7b430675cd79e756d for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,031 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2/3d478ced25cb407b9d6b3350c11dfb60] hfiles 2023-02-13 20:04:03,031 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2/3d478ced25cb407b9d6b3350c11dfb60 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,036 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. completed. 2023-02-13 20:04:03,036 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,036 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 20:04:03,036 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 20:04:03,036 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,036 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 20:04:03,036 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37245,1676318641132' in zk 2023-02-13 20:04:03,039 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,039 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 20:04:03,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:03,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:04:03,039 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:03,039 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 20:04:03,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:03,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:03,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:03,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,37245,1676318641132': 2023-02-13 20:04:03,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37245,1676318641132' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 20:04:03,042 INFO [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-13 20:04:03,042 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:04:03,042 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:04:03,042 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,042 INFO [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 20:04:03,043 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,043 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,043 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,043 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:04:03,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,043 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:04:03,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:03,044 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:04:03,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:04:03,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:03,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:04:03,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:03,044 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:03,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:03,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,046 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,046 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:03,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,051 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,051 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,051 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:04:03,051 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:04:03,051 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:04:03,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:04:03,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:03,051 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:04:03,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,051 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:03,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:04:03,051 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:04:03,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:03,052 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:03,052 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,052 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,052 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,052 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,052 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:04:03,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:03,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,066 DEBUG [Listener at localhost/35657] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:04:03,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-13 20:04:03,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:04:03,067 DEBUG [Listener at localhost/35657] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 20:04:03,079 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-13 20:04:03,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,080 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676318642964Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676318643052 (+88 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676318643052Writing data manifest for testWithMockedMapReduceSingleRegion at 1676318643054 (+2 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676318643060 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676318643079 (+19 ms) 2023-02-13 20:04:03,081 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 20:04:03,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 117 msec 2023-02-13 20:04:03,267 DEBUG [Listener at localhost/35657] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:04:03,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-13 20:04:03,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 20:04:03,269 INFO [Listener at localhost/35657] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 20:04:03,272 INFO [Listener at localhost/35657] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 20:04:03,276 INFO [Listener at localhost/35657] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 20:04:03,302 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37245] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,387 INFO [Listener at localhost/35657] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 20:04:03,392 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 20:04:03,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,394 INFO [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-13 20:04:03,394 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:04:03,395 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-13 20:04:03,395 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 20:04:03,395 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,395 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,396 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:04:03,397 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:04:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:03,397 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:04:03,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:04:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:03,397 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,397 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:04:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:04:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,398 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:04:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,398 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,398 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-13 20:04:03,398 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:04:03,398 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-13 20:04:03,398 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:04:03,399 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 20:04:03,400 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 20:04:03,400 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 20:04:03,400 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34263,1676318641170' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 20:04:03,400 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 20:04:03,400 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 20:04:03,400 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,400 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. started... 2023-02-13 20:04:03,400 INFO [rs(jenkins-hbase4.apache.org,37245,1676318641132)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 87bcfad57cedbf37b3917a8d1997198c 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 20:04:03,401 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,402 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,402 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:04:03,421 INFO [rs(jenkins-hbase4.apache.org,37245,1676318641132)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/.tmp/f1/a6bb916b572241bfad87243c3deb17cf 2023-02-13 20:04:03,446 INFO [rs(jenkins-hbase4.apache.org,37245,1676318641132)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/.tmp/f2/2fa0216982704d6b9728a68a861b19ae 2023-02-13 20:04:03,450 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/.tmp/f1/a6bb916b572241bfad87243c3deb17cf as hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1/a6bb916b572241bfad87243c3deb17cf 2023-02-13 20:04:03,454 INFO [rs(jenkins-hbase4.apache.org,37245,1676318641132)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1/a6bb916b572241bfad87243c3deb17cf, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 20:04:03,455 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/.tmp/f2/2fa0216982704d6b9728a68a861b19ae as hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2/2fa0216982704d6b9728a68a861b19ae 2023-02-13 20:04:03,459 INFO [rs(jenkins-hbase4.apache.org,37245,1676318641132)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2/2fa0216982704d6b9728a68a861b19ae, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 20:04:03,460 INFO [rs(jenkins-hbase4.apache.org,37245,1676318641132)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 87bcfad57cedbf37b3917a8d1997198c in 60ms, sequenceid=9, compaction requested=false 2023-02-13 20:04:03,461 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 87bcfad57cedbf37b3917a8d1997198c: 2023-02-13 20:04:03,461 DEBUG [rs(jenkins-hbase4.apache.org,37245,1676318641132)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,461 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 20:04:03,461 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 20:04:03,461 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,461 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 20:04:03,461 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37245,1676318641132' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 20:04:03,463 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:03,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:04:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:04:03,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:03,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:03,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:03,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37245,1676318641132' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-13 20:04:03,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3eb59235[Count = 0] remaining members to acquire global barrier 2023-02-13 20:04:03,465 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 20:04:03,465 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,472 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,472 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,472 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,472 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:04:03,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,472 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 20:04:03,472 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 20:04:03,472 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 20:04:03,472 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 20:04:03,472 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,37245,1676318641132' in zk 2023-02-13 20:04:03,472 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,34263,1676318641170' in zk 2023-02-13 20:04:03,474 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,474 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 20:04:03,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:03,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:04:03,474 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:03,474 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 20:04:03,474 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:03,474 DEBUG [member: 'jenkins-hbase4.apache.org,37245,1676318641132' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 20:04:03,474 DEBUG [member: 'jenkins-hbase4.apache.org,34263,1676318641170' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 20:04:03,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:03,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,37245,1676318641132': 2023-02-13 20:04:03,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37245,1676318641132' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 20:04:03,476 INFO [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-13 20:04:03,476 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:04:03,476 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:04:03,476 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,476 INFO [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 20:04:03,478 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,478 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,478 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:04:03,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,478 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:04:03,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,478 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:04:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:03,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:04:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:03,478 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:04:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,479 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:03,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:03,481 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,481 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,483 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,483 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:04:03,483 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:04:03,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:03,483 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:04:03,483 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:04:03,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:04:03,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:03,483 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:04:03,483 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-13 20:04:03,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:04:03,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:03,483 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,483 DEBUG [(jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:03,484 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,483 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 20:04:03,484 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:03,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:04:03,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:03,484 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,484 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,484 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,484 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,484 DEBUG [Listener at localhost/35657] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-13 20:04:03,484 DEBUG [Listener at localhost/35657] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 20:04:03,584 DEBUG [Listener at localhost/35657] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 20:04:03,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 20:04:03,590 INFO [Listener at localhost/35657] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676318642953 type: FLUSH version: 2 ttl: 0 2023-02-13 20:04:03,590 DEBUG [Listener at localhost/35657] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33453/user/jenkins/test-data/873504cc-e17a-efdd-e983-13045ba9ed45/testWithMockedMapReduceSingleRegion/6d38b81a-d51a-4558-9473-2f963cf69433/data/default/testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,590 INFO [Listener at localhost/35657] snapshot.RestoreSnapshotHelper(239): region to add: 87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:03,590 INFO [Listener at localhost/35657] snapshot.RestoreSnapshotHelper(585): clone region=87bcfad57cedbf37b3917a8d1997198c as 87bcfad57cedbf37b3917a8d1997198c in snapshot testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,591 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 87bcfad57cedbf37b3917a8d1997198c, NAME => 'testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33453/user/jenkins/test-data/873504cc-e17a-efdd-e983-13045ba9ed45/testWithMockedMapReduceSingleRegion/6d38b81a-d51a-4558-9473-2f963cf69433 2023-02-13 20:04:03,597 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:03,597 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9d0c5a846e464ac7b430675cd79e756d from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,599 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3d478ced25cb407b9d6b3350c11dfb60 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,600 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 87bcfad57cedbf37b3917a8d1997198c, disabling compactions & flushes 2023-02-13 20:04:03,601 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,601 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,601 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. after waiting 0 ms 2023-02-13 20:04:03,601 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,601 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,601 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 87bcfad57cedbf37b3917a8d1997198c: Waiting for close lock at 1676318643600Disabling compacts and flushes for region at 1676318643600Disabling writes for close at 1676318643601 (+1 ms)Writing region close event to WAL at 1676318643601Closed at 1676318643601 2023-02-13 20:04:03,601 INFO [Listener at localhost/35657] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676318642953 type: FLUSH version: 2 ttl: 0 2023-02-13 20:04:03,601 DEBUG [Listener at localhost/35657] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:33453/user/jenkins/test-data/873504cc-e17a-efdd-e983-13045ba9ed45/testWithMockedMapReduceSingleRegion/6d38b81a-d51a-4558-9473-2f963cf69433 2023-02-13 20:04:03,601 DEBUG [Listener at localhost/35657] util.CommonFSUtils(682): File system contents for path hdfs://localhost:33453/user/jenkins/test-data/873504cc-e17a-efdd-e983-13045ba9ed45/testWithMockedMapReduceSingleRegion/6d38b81a-d51a-4558-9473-2f963cf69433 2023-02-13 20:04:03,602 DEBUG [Listener at localhost/35657] util.CommonFSUtils(699): |-data/ 2023-02-13 20:04:03,602 DEBUG [Listener at localhost/35657] util.CommonFSUtils(699): |----default/ 2023-02-13 20:04:03,602 DEBUG [Listener at localhost/35657] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-13 20:04:03,602 DEBUG [Listener at localhost/35657] util.CommonFSUtils(699): |----------87bcfad57cedbf37b3917a8d1997198c/ 2023-02-13 20:04:03,603 DEBUG [Listener at localhost/35657] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:04:03,603 DEBUG [Listener at localhost/35657] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:04:03,603 DEBUG [Listener at localhost/35657] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=87bcfad57cedbf37b3917a8d1997198c-9d0c5a846e464ac7b430675cd79e756d 2023-02-13 20:04:03,603 DEBUG [Listener at localhost/35657] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:04:03,603 DEBUG [Listener at localhost/35657] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=87bcfad57cedbf37b3917a8d1997198c-3d478ced25cb407b9d6b3350c11dfb60 2023-02-13 20:04:03,606 INFO [Listener at localhost/35657] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 20:04:03,609 DEBUG [Listener at localhost/35657] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:03,609 INFO [Listener at localhost/35657] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:04:03,609 DEBUG [Listener at localhost/35657] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:04:03,611 INFO [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:03,611 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 20:04:03,611 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-13 20:04:03,612 DEBUG [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/873504cc-e17a-efdd-e983-13045ba9ed45/testWithMockedMapReduceSingleRegion/6d38b81a-d51a-4558-9473-2f963cf69433/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1 2023-02-13 20:04:03,612 INFO [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87bcfad57cedbf37b3917a8d1997198c columnFamilyName f1 2023-02-13 20:04:03,615 DEBUG [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] regionserver.HStore(539): loaded hdfs://localhost:33453/user/jenkins/test-data/873504cc-e17a-efdd-e983-13045ba9ed45/testWithMockedMapReduceSingleRegion/6d38b81a-d51a-4558-9473-2f963cf69433/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1/testWithMockedMapReduceSingleRegion=87bcfad57cedbf37b3917a8d1997198c-9d0c5a846e464ac7b430675cd79e756d 2023-02-13 20:04:03,615 INFO [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] regionserver.HStore(310): Store=87bcfad57cedbf37b3917a8d1997198c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:03,616 INFO [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:03,616 DEBUG [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33453/user/jenkins/test-data/873504cc-e17a-efdd-e983-13045ba9ed45/testWithMockedMapReduceSingleRegion/6d38b81a-d51a-4558-9473-2f963cf69433/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2 2023-02-13 20:04:03,616 INFO [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87bcfad57cedbf37b3917a8d1997198c columnFamilyName f2 2023-02-13 20:04:03,620 DEBUG [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] regionserver.HStore(539): loaded hdfs://localhost:33453/user/jenkins/test-data/873504cc-e17a-efdd-e983-13045ba9ed45/testWithMockedMapReduceSingleRegion/6d38b81a-d51a-4558-9473-2f963cf69433/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2/testWithMockedMapReduceSingleRegion=87bcfad57cedbf37b3917a8d1997198c-3d478ced25cb407b9d6b3350c11dfb60 2023-02-13 20:04:03,620 INFO [StoreOpener-87bcfad57cedbf37b3917a8d1997198c-1] regionserver.HStore(310): Store=87bcfad57cedbf37b3917a8d1997198c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:03,620 DEBUG [Listener at localhost/35657] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:04:03,620 INFO [Listener at localhost/35657] regionserver.HRegion(1071): Opened 87bcfad57cedbf37b3917a8d1997198c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73653497, jitterRate=0.09752263128757477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:04:03,620 DEBUG [Listener at localhost/35657] regionserver.HRegion(964): Region open journal for 87bcfad57cedbf37b3917a8d1997198c: Writing region info on filesystem at 1676318643609Initializing all the Stores at 1676318643610 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318643610Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318643610Region opened successfully at 1676318643620 (+10 ms) 2023-02-13 20:04:03,665 DEBUG [Listener at localhost/35657] regionserver.HRegion(1603): Closing 87bcfad57cedbf37b3917a8d1997198c, disabling compactions & flushes 2023-02-13 20:04:03,666 INFO [Listener at localhost/35657] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,666 DEBUG [Listener at localhost/35657] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,666 DEBUG [Listener at localhost/35657] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. after waiting 0 ms 2023-02-13 20:04:03,666 DEBUG [Listener at localhost/35657] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,666 INFO [Listener at localhost/35657] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,667 DEBUG [Listener at localhost/35657] regionserver.HRegion(1557): Region close journal for 87bcfad57cedbf37b3917a8d1997198c: Waiting for close lock at 1676318643665Disabling compacts and flushes for region at 1676318643665Disabling writes for close at 1676318643666 (+1 ms)Writing region close event to WAL at 1676318643666Closed at 1676318643666 2023-02-13 20:04:03,671 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-13 20:04:03,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,673 INFO [Listener at localhost/35657] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,674 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 20:04:03,677 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318643677"}]},"ts":"1676318643677"} 2023-02-13 20:04:03,678 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-13 20:04:03,681 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-13 20:04:03,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=87bcfad57cedbf37b3917a8d1997198c, UNASSIGN}] 2023-02-13 20:04:03,683 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=87bcfad57cedbf37b3917a8d1997198c, UNASSIGN 2023-02-13 20:04:03,683 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=87bcfad57cedbf37b3917a8d1997198c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:03,683 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676318643683"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318643683"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318643683"}]},"ts":"1676318643683"} 2023-02-13 20:04:03,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 87bcfad57cedbf37b3917a8d1997198c, server=jenkins-hbase4.apache.org,37245,1676318641132}] 2023-02-13 20:04:03,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 20:04:03,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:03,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 87bcfad57cedbf37b3917a8d1997198c, disabling compactions & flushes 2023-02-13 20:04:03,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. after waiting 0 ms 2023-02-13 20:04:03,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:04:03,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c. 2023-02-13 20:04:03,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 87bcfad57cedbf37b3917a8d1997198c: Waiting for close lock at 1676318643837Running coprocessor pre-close hooks at 1676318643837Disabling compacts and flushes for region at 1676318643837Disabling writes for close at 1676318643837Writing region close event to WAL at 1676318643838 (+1 ms)Running coprocessor post-close hooks at 1676318643841 (+3 ms)Closed at 1676318643841 2023-02-13 20:04:03,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:03,843 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=87bcfad57cedbf37b3917a8d1997198c, regionState=CLOSED 2023-02-13 20:04:03,843 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676318643843"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318643843"}]},"ts":"1676318643843"} 2023-02-13 20:04:03,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 20:04:03,846 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 87bcfad57cedbf37b3917a8d1997198c, server=jenkins-hbase4.apache.org,37245,1676318641132 in 160 msec 2023-02-13 20:04:03,847 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 20:04:03,847 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=87bcfad57cedbf37b3917a8d1997198c, UNASSIGN in 165 msec 2023-02-13 20:04:03,848 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318643848"}]},"ts":"1676318643848"} 2023-02-13 20:04:03,849 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-13 20:04:03,851 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-13 20:04:03,852 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 177 msec 2023-02-13 20:04:03,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 20:04:03,980 INFO [Listener at localhost/35657] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-13 20:04:03,981 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,983 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,984 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 20:04:03,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 20:04:03,986 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:03,988 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1, FileablePath, hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2, FileablePath, hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/recovered.edits] 2023-02-13 20:04:03,991 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1/9d0c5a846e464ac7b430675cd79e756d to hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/archive/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1/9d0c5a846e464ac7b430675cd79e756d 2023-02-13 20:04:03,992 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1/a6bb916b572241bfad87243c3deb17cf to hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/archive/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f1/a6bb916b572241bfad87243c3deb17cf 2023-02-13 20:04:03,994 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2/2fa0216982704d6b9728a68a861b19ae to hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/archive/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2/2fa0216982704d6b9728a68a861b19ae 2023-02-13 20:04:03,995 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2/3d478ced25cb407b9d6b3350c11dfb60 to hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/archive/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/f2/3d478ced25cb407b9d6b3350c11dfb60 2023-02-13 20:04:03,998 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/recovered.edits/12.seqid to hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/archive/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c/recovered.edits/12.seqid 2023-02-13 20:04:03,998 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/.tmp/data/default/testWithMockedMapReduceSingleRegion/87bcfad57cedbf37b3917a8d1997198c 2023-02-13 20:04:03,998 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-13 20:04:04,000 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 20:04:04,001 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-13 20:04:04,002 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-13 20:04:04,003 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 20:04:04,003 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-13 20:04:04,003 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318644003"}]},"ts":"9223372036854775807"} 2023-02-13 20:04:04,005 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 20:04:04,005 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 87bcfad57cedbf37b3917a8d1997198c, NAME => 'testWithMockedMapReduceSingleRegion,,1676318642212.87bcfad57cedbf37b3917a8d1997198c.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 20:04:04,005 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-13 20:04:04,005 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676318644005"}]},"ts":"9223372036854775807"} 2023-02-13 20:04:04,006 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-13 20:04:04,007 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 20:04:04,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 26 msec 2023-02-13 20:04:04,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33989] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 20:04:04,086 INFO [Listener at localhost/35657] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-13 20:04:04,086 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 20:04:04,086 INFO [Listener at localhost/35657] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 20:04:04,086 DEBUG [Listener at localhost/35657] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11a91808 to 127.0.0.1:54848 2023-02-13 20:04:04,086 DEBUG [Listener at localhost/35657] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:04,086 DEBUG [Listener at localhost/35657] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 20:04:04,086 DEBUG [Listener at localhost/35657] util.JVMClusterUtil(257): Found active master hash=2126500967, stopped=false 2023-02-13 20:04:04,086 INFO [Listener at localhost/35657] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33989,1676318641078 2023-02-13 20:04:04,089 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:04,089 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:04,089 INFO [Listener at localhost/35657] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 20:04:04,089 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:04,089 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:04,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:04,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:04,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:04,091 DEBUG [Listener at localhost/35657] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bbef56f to 127.0.0.1:54848 2023-02-13 20:04:04,091 DEBUG [Listener at localhost/35657] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:04,091 INFO [Listener at localhost/35657] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37245,1676318641132' ***** 2023-02-13 20:04:04,091 INFO [Listener at localhost/35657] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:04:04,091 INFO [RS:0;jenkins-hbase4:37245] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:04:04,091 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:04:04,091 INFO [Listener at localhost/35657] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34263,1676318641170' ***** 2023-02-13 20:04:04,092 INFO [Listener at localhost/35657] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:04:04,091 INFO [RS:0;jenkins-hbase4:37245] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:04:04,092 INFO [RS:0;jenkins-hbase4:37245] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:04:04,092 INFO [RS:1;jenkins-hbase4:34263] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:04:04,092 INFO [RS:0;jenkins-hbase4:37245] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:04,092 INFO [RS:1;jenkins-hbase4:34263] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:04:04,092 DEBUG [RS:0;jenkins-hbase4:37245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d995b2d to 127.0.0.1:54848 2023-02-13 20:04:04,092 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:04:04,093 DEBUG [RS:0;jenkins-hbase4:37245] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:04,092 INFO [RS:1;jenkins-hbase4:34263] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:04:04,093 INFO [RS:0;jenkins-hbase4:37245] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37245,1676318641132; all regions closed. 2023-02-13 20:04:04,093 INFO [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(3304): Received CLOSE for 46d99b8ce0368f5cb0af5a91df59ba99 2023-02-13 20:04:04,094 INFO [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:04,094 DEBUG [RS:1;jenkins-hbase4:34263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x413e0b63 to 127.0.0.1:54848 2023-02-13 20:04:04,094 DEBUG [RS:1;jenkins-hbase4:34263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:04,094 INFO [RS:1;jenkins-hbase4:34263] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:04:04,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 46d99b8ce0368f5cb0af5a91df59ba99, disabling compactions & flushes 2023-02-13 20:04:04,094 INFO [RS:1;jenkins-hbase4:34263] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:04:04,094 INFO [RS:1;jenkins-hbase4:34263] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:04:04,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. 2023-02-13 20:04:04,094 INFO [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 20:04:04,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. 2023-02-13 20:04:04,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. after waiting 0 ms 2023-02-13 20:04:04,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. 2023-02-13 20:04:04,094 INFO [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-13 20:04:04,094 DEBUG [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 46d99b8ce0368f5cb0af5a91df59ba99=hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99.} 2023-02-13 20:04:04,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:04:04,094 DEBUG [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(1505): Waiting on 1588230740, 46d99b8ce0368f5cb0af5a91df59ba99 2023-02-13 20:04:04,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 46d99b8ce0368f5cb0af5a91df59ba99 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 20:04:04,094 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:04:04,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:04:04,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:04:04,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:04:04,094 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-13 20:04:04,096 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/WALs/jenkins-hbase4.apache.org,37245,1676318641132/jenkins-hbase4.apache.org%2C37245%2C1676318641132.1676318642479 not finished, retry = 0 2023-02-13 20:04:04,106 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/.tmp/info/f1917edc058a477c9c11b956845a2613 2023-02-13 20:04:04,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/namespace/46d99b8ce0368f5cb0af5a91df59ba99/.tmp/info/27502925fe41408ea346b9e030b80c0c 2023-02-13 20:04:04,111 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1917edc058a477c9c11b956845a2613 2023-02-13 20:04:04,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/namespace/46d99b8ce0368f5cb0af5a91df59ba99/.tmp/info/27502925fe41408ea346b9e030b80c0c as hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/namespace/46d99b8ce0368f5cb0af5a91df59ba99/info/27502925fe41408ea346b9e030b80c0c 2023-02-13 20:04:04,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/namespace/46d99b8ce0368f5cb0af5a91df59ba99/info/27502925fe41408ea346b9e030b80c0c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 20:04:04,116 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 46d99b8ce0368f5cb0af5a91df59ba99 in 22ms, sequenceid=6, compaction requested=false 2023-02-13 20:04:04,123 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/.tmp/rep_barrier/be98aa33ca604742b550736ead8a4a99 2023-02-13 20:04:04,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/namespace/46d99b8ce0368f5cb0af5a91df59ba99/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 20:04:04,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. 2023-02-13 20:04:04,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 46d99b8ce0368f5cb0af5a91df59ba99: Waiting for close lock at 1676318644094Running coprocessor pre-close hooks at 1676318644094Disabling compacts and flushes for region at 1676318644094Disabling writes for close at 1676318644094Obtaining lock to block concurrent updates at 1676318644094Preparing flush snapshotting stores in 46d99b8ce0368f5cb0af5a91df59ba99 at 1676318644094Finished memstore snapshotting hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676318644094Flushing stores of hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. at 1676318644096 (+2 ms)Flushing 46d99b8ce0368f5cb0af5a91df59ba99/info: creating writer at 1676318644096Flushing 46d99b8ce0368f5cb0af5a91df59ba99/info: appending metadata at 1676318644098 (+2 ms)Flushing 46d99b8ce0368f5cb0af5a91df59ba99/info: closing flushed file at 1676318644098Flushing 46d99b8ce0368f5cb0af5a91df59ba99/info: reopening flushed file at 1676318644113 (+15 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 46d99b8ce0368f5cb0af5a91df59ba99 in 22ms, sequenceid=6, compaction requested=false at 1676318644116 (+3 ms)Writing region close event to WAL at 1676318644122 (+6 ms)Running coprocessor post-close hooks at 1676318644126 (+4 ms)Closed at 1676318644126 2023-02-13 20:04:04,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676318641722.46d99b8ce0368f5cb0af5a91df59ba99. 2023-02-13 20:04:04,126 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be98aa33ca604742b550736ead8a4a99 2023-02-13 20:04:04,134 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/.tmp/table/0b08910750bc4ed687b4d072f9c4cb8e 2023-02-13 20:04:04,137 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b08910750bc4ed687b4d072f9c4cb8e 2023-02-13 20:04:04,138 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/.tmp/info/f1917edc058a477c9c11b956845a2613 as hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/info/f1917edc058a477c9c11b956845a2613 2023-02-13 20:04:04,141 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1917edc058a477c9c11b956845a2613 2023-02-13 20:04:04,141 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/info/f1917edc058a477c9c11b956845a2613, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 20:04:04,142 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/.tmp/rep_barrier/be98aa33ca604742b550736ead8a4a99 as hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/rep_barrier/be98aa33ca604742b550736ead8a4a99 2023-02-13 20:04:04,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be98aa33ca604742b550736ead8a4a99 2023-02-13 20:04:04,146 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/rep_barrier/be98aa33ca604742b550736ead8a4a99, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 20:04:04,146 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/.tmp/table/0b08910750bc4ed687b4d072f9c4cb8e as hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/table/0b08910750bc4ed687b4d072f9c4cb8e 2023-02-13 20:04:04,149 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0b08910750bc4ed687b4d072f9c4cb8e 2023-02-13 20:04:04,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/table/0b08910750bc4ed687b4d072f9c4cb8e, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 20:04:04,153 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:04:04,153 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 59ms, sequenceid=21, compaction requested=false 2023-02-13 20:04:04,153 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:04:04,157 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 20:04:04,157 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 20:04:04,157 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:04:04,157 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318644094Running coprocessor pre-close hooks at 1676318644094Disabling compacts and flushes for region at 1676318644094Disabling writes for close at 1676318644094Obtaining lock to block concurrent updates at 1676318644094Preparing flush snapshotting stores in 1588230740 at 1676318644094Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676318644095 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676318644096 (+1 ms)Flushing 1588230740/info: creating writer at 1676318644096Flushing 1588230740/info: appending metadata at 1676318644098 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676318644098Flushing 1588230740/rep_barrier: creating writer at 1676318644111 (+13 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676318644113 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676318644113Flushing 1588230740/table: creating writer at 1676318644127 (+14 ms)Flushing 1588230740/table: appending metadata at 1676318644128 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676318644128Flushing 1588230740/info: reopening flushed file at 1676318644138 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676318644143 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676318644147 (+4 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 59ms, sequenceid=21, compaction requested=false at 1676318644153 (+6 ms)Writing region close event to WAL at 1676318644155 (+2 ms)Running coprocessor post-close hooks at 1676318644157 (+2 ms)Closed at 1676318644157 2023-02-13 20:04:04,157 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 20:04:04,198 DEBUG [RS:0;jenkins-hbase4:37245] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/oldWALs 2023-02-13 20:04:04,198 INFO [RS:0;jenkins-hbase4:37245] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37245%2C1676318641132:(num 1676318642479) 2023-02-13 20:04:04,198 DEBUG [RS:0;jenkins-hbase4:37245] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:04,198 INFO [RS:0;jenkins-hbase4:37245] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:04:04,198 INFO [RS:0;jenkins-hbase4:37245] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 20:04:04,199 INFO [RS:0;jenkins-hbase4:37245] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:04:04,199 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:04:04,199 INFO [RS:0;jenkins-hbase4:37245] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:04:04,199 INFO [RS:0;jenkins-hbase4:37245] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:04:04,200 INFO [RS:0;jenkins-hbase4:37245] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37245 2023-02-13 20:04:04,203 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:04,203 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:04,203 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37245,1676318641132 2023-02-13 20:04:04,203 ERROR [Listener at localhost/35657-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7d628b08 rejected from java.util.concurrent.ThreadPoolExecutor@795d107c[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:04,203 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:04,204 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:04,204 ERROR [Listener at localhost/35657-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@647af0af rejected from java.util.concurrent.ThreadPoolExecutor@795d107c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:04,204 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37245,1676318641132] 2023-02-13 20:04:04,204 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37245,1676318641132; numProcessing=1 2023-02-13 20:04:04,207 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37245,1676318641132 already deleted, retry=false 2023-02-13 20:04:04,207 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37245,1676318641132 expired; onlineServers=1 2023-02-13 20:04:04,294 INFO [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34263,1676318641170; all regions closed. 2023-02-13 20:04:04,299 DEBUG [RS:1;jenkins-hbase4:34263] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/oldWALs 2023-02-13 20:04:04,299 INFO [RS:1;jenkins-hbase4:34263] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34263%2C1676318641170.meta:.meta(num 1676318641675) 2023-02-13 20:04:04,302 DEBUG [RS:1;jenkins-hbase4:34263] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/oldWALs 2023-02-13 20:04:04,302 INFO [RS:1;jenkins-hbase4:34263] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34263%2C1676318641170:(num 1676318642073) 2023-02-13 20:04:04,302 DEBUG [RS:1;jenkins-hbase4:34263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:04,302 INFO [RS:1;jenkins-hbase4:34263] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:04:04,303 INFO [RS:1;jenkins-hbase4:34263] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 20:04:04,303 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:04:04,304 INFO [RS:1;jenkins-hbase4:34263] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34263 2023-02-13 20:04:04,306 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34263,1676318641170 2023-02-13 20:04:04,306 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:04,306 ERROR [Listener at localhost/35657-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2be85852 rejected from java.util.concurrent.ThreadPoolExecutor@2fd7d9f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:04,308 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34263,1676318641170] 2023-02-13 20:04:04,308 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34263,1676318641170; numProcessing=2 2023-02-13 20:04:04,311 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34263,1676318641170 already deleted, retry=false 2023-02-13 20:04:04,311 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34263,1676318641170 expired; onlineServers=0 2023-02-13 20:04:04,311 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33989,1676318641078' ***** 2023-02-13 20:04:04,311 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 20:04:04,312 DEBUG [M:0;jenkins-hbase4:33989] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a805f68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:04:04,312 INFO [M:0;jenkins-hbase4:33989] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33989,1676318641078 2023-02-13 20:04:04,312 INFO [M:0;jenkins-hbase4:33989] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33989,1676318641078; all regions closed. 2023-02-13 20:04:04,312 DEBUG [M:0;jenkins-hbase4:33989] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:04,312 DEBUG [M:0;jenkins-hbase4:33989] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 20:04:04,312 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 20:04:04,312 DEBUG [M:0;jenkins-hbase4:33989] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 20:04:04,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318641322] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318641322,5,FailOnTimeoutGroup] 2023-02-13 20:04:04,312 INFO [M:0;jenkins-hbase4:33989] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 20:04:04,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318641322] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318641322,5,FailOnTimeoutGroup] 2023-02-13 20:04:04,313 INFO [M:0;jenkins-hbase4:33989] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 20:04:04,314 INFO [M:0;jenkins-hbase4:33989] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 20:04:04,314 DEBUG [M:0;jenkins-hbase4:33989] master.HMaster(1502): Stopping service threads 2023-02-13 20:04:04,314 INFO [M:0;jenkins-hbase4:33989] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 20:04:04,314 ERROR [M:0;jenkins-hbase4:33989] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 20:04:04,314 INFO [M:0;jenkins-hbase4:33989] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 20:04:04,314 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 20:04:04,315 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 20:04:04,315 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:04,315 DEBUG [M:0;jenkins-hbase4:33989] zookeeper.ZKUtil(398): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 20:04:04,315 WARN [M:0;jenkins-hbase4:33989] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 20:04:04,315 INFO [M:0;jenkins-hbase4:33989] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 20:04:04,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:04:04,315 INFO [M:0;jenkins-hbase4:33989] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 20:04:04,315 DEBUG [M:0;jenkins-hbase4:33989] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:04:04,315 INFO [M:0;jenkins-hbase4:33989] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:04,316 DEBUG [M:0;jenkins-hbase4:33989] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:04,316 DEBUG [M:0;jenkins-hbase4:33989] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:04:04,316 DEBUG [M:0;jenkins-hbase4:33989] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:04,316 INFO [M:0;jenkins-hbase4:33989] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.12 KB heapSize=67.06 KB 2023-02-13 20:04:04,325 INFO [M:0;jenkins-hbase4:33989] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.12 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d78a510410af4f468d98a449860d5a3d 2023-02-13 20:04:04,329 DEBUG [M:0;jenkins-hbase4:33989] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d78a510410af4f468d98a449860d5a3d as hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d78a510410af4f468d98a449860d5a3d 2023-02-13 20:04:04,333 INFO [M:0;jenkins-hbase4:33989] regionserver.HStore(1080): Added hdfs://localhost:33453/user/jenkins/test-data/e7fed318-f877-6243-a448-72aab4ba5c7a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d78a510410af4f468d98a449860d5a3d, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 20:04:04,334 INFO [M:0;jenkins-hbase4:33989] regionserver.HRegion(2947): Finished flush of dataSize ~56.12 KB/57462, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-13 20:04:04,334 INFO [M:0;jenkins-hbase4:33989] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:04,334 DEBUG [M:0;jenkins-hbase4:33989] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318644315Disabling compacts and flushes for region at 1676318644315Disabling writes for close at 1676318644316 (+1 ms)Obtaining lock to block concurrent updates at 1676318644316Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676318644316Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57462, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1676318644316Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676318644317 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676318644317Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676318644319 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676318644319Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676318644330 (+11 ms)Finished flush of dataSize ~56.12 KB/57462, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1676318644334 (+4 ms)Writing region close event to WAL at 1676318644334Closed at 1676318644334 2023-02-13 20:04:04,337 INFO [M:0;jenkins-hbase4:33989] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 20:04:04,337 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:04:04,338 INFO [M:0;jenkins-hbase4:33989] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33989 2023-02-13 20:04:04,341 DEBUG [M:0;jenkins-hbase4:33989] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33989,1676318641078 already deleted, retry=false 2023-02-13 20:04:04,395 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:04,395 INFO [RS:0;jenkins-hbase4:37245] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37245,1676318641132; zookeeper connection closed. 2023-02-13 20:04:04,395 ERROR [Listener at localhost/35657-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1c6632da rejected from java.util.concurrent.ThreadPoolExecutor@795d107c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:04,396 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:37245-0x1004f4875650001, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:04,396 ERROR [Listener at localhost/35657-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6fbc02d5 rejected from java.util.concurrent.ThreadPoolExecutor@795d107c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:04,396 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@60558a8f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@60558a8f 2023-02-13 20:04:04,597 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:04,597 INFO [M:0;jenkins-hbase4:33989] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33989,1676318641078; zookeeper connection closed. 2023-02-13 20:04:04,597 ERROR [Listener at localhost/35657-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@17f30b05 rejected from java.util.concurrent.ThreadPoolExecutor@13cc9d23[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:04,600 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): master:33989-0x1004f4875650000, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:04,600 ERROR [Listener at localhost/35657-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68f6f3da rejected from java.util.concurrent.ThreadPoolExecutor@13cc9d23[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:04,697 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:04,697 INFO [RS:1;jenkins-hbase4:34263] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34263,1676318641170; zookeeper connection closed. 2023-02-13 20:04:04,697 ERROR [Listener at localhost/35657-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@32b66e3e rejected from java.util.concurrent.ThreadPoolExecutor@2fd7d9f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:04,697 DEBUG [Listener at localhost/35657-EventThread] zookeeper.ZKWatcher(600): regionserver:34263-0x1004f4875650002, quorum=127.0.0.1:54848, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:04,697 ERROR [Listener at localhost/35657-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4a7cf81a rejected from java.util.concurrent.ThreadPoolExecutor@2fd7d9f7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:04,697 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7c734e11] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7c734e11 2023-02-13 20:04:04,698 INFO [Listener at localhost/35657] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 20:04:04,699 WARN [Listener at localhost/35657] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:04:04,702 INFO [Listener at localhost/35657] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:04:04,807 WARN [BP-733250859-172.31.14.131-1676318640441 heartbeating to localhost/127.0.0.1:33453] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 20:04:04,807 WARN [BP-733250859-172.31.14.131-1676318640441 heartbeating to localhost/127.0.0.1:33453] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-733250859-172.31.14.131-1676318640441 (Datanode Uuid b62556e5-e0be-4cff-8278-74cbb093f77f) service to localhost/127.0.0.1:33453 2023-02-13 20:04:04,808 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/cluster_4d5bbd10-da0b-4cfc-85c6-36441593fae3/dfs/data/data3/current/BP-733250859-172.31.14.131-1676318640441] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:04,808 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/cluster_4d5bbd10-da0b-4cfc-85c6-36441593fae3/dfs/data/data4/current/BP-733250859-172.31.14.131-1676318640441] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:04,809 WARN [Listener at localhost/35657] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:04:04,813 INFO [Listener at localhost/35657] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:04:04,917 WARN [BP-733250859-172.31.14.131-1676318640441 heartbeating to localhost/127.0.0.1:33453] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 20:04:04,918 WARN [BP-733250859-172.31.14.131-1676318640441 heartbeating to localhost/127.0.0.1:33453] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-733250859-172.31.14.131-1676318640441 (Datanode Uuid 4b81c816-5bbc-445d-8974-7966f2cea4cc) service to localhost/127.0.0.1:33453 2023-02-13 20:04:04,918 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/cluster_4d5bbd10-da0b-4cfc-85c6-36441593fae3/dfs/data/data1/current/BP-733250859-172.31.14.131-1676318640441] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:04,918 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/cluster_4d5bbd10-da0b-4cfc-85c6-36441593fae3/dfs/data/data2/current/BP-733250859-172.31.14.131-1676318640441] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:04,929 INFO [Listener at localhost/35657] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:04:05,042 INFO [Listener at localhost/35657] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 20:04:05,056 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 20:04:05,068 INFO [Listener at localhost/35657] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=253 (was 228) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:33453 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/35657 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:33453 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:33453 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:33453 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33989,1676318641078)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:33453 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35657.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:33453 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:33453 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=654 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=312 (was 313), ProcessCount=166 (was 166), AvailableMemoryMB=1465 (was 1487) 2023-02-13 20:04:05,078 INFO [Listener at localhost/35657] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=253, OpenFileDescriptor=654, MaxFileDescriptor=60000, SystemLoadAverage=312, ProcessCount=166, AvailableMemoryMB=1465 2023-02-13 20:04:05,089 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/hadoop.log.dir so I do NOT create it in target/test-data/b109a052-b996-3d27-a647-eb6222f54809 2023-02-13 20:04:05,089 WARN [Listener at localhost/35657] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 20:04:05,089 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/hadoop.tmp.dir so I do NOT create it in target/test-data/b109a052-b996-3d27-a647-eb6222f54809 2023-02-13 20:04:05,089 WARN [Listener at localhost/35657] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/18fd636e-3e9e-80d9-8db5-671abf6054b1/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 20:04:05,089 DEBUG [Listener at localhost/35657] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809 2023-02-13 20:04:05,089 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 20:04:05,089 INFO [Listener at localhost/35657] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/cluster_509b7b7e-ade4-cffe-62ef-01ce8c214228, deleteOnExit=true 2023-02-13 20:04:05,089 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 20:04:05,089 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/test.cache.data in system properties and HBase conf 2023-02-13 20:04:05,090 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 20:04:05,090 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/hadoop.log.dir in system properties and HBase conf 2023-02-13 20:04:05,090 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 20:04:05,090 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 20:04:05,090 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 20:04:05,090 DEBUG [Listener at localhost/35657] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 20:04:05,090 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:04:05,090 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:04:05,090 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 20:04:05,090 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:04:05,091 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 20:04:05,091 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 20:04:05,091 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:04:05,091 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:04:05,091 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 20:04:05,091 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/nfs.dump.dir in system properties and HBase conf 2023-02-13 20:04:05,091 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/java.io.tmpdir in system properties and HBase conf 2023-02-13 20:04:05,091 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:04:05,091 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 20:04:05,091 INFO [Listener at localhost/35657] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 20:04:05,096 WARN [Listener at localhost/35657] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:04:05,096 WARN [Listener at localhost/35657] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:04:05,136 WARN [Listener at localhost/35657] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:04:05,137 INFO [Listener at localhost/35657] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:04:05,142 INFO [Listener at localhost/35657] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/java.io.tmpdir/Jetty_localhost_44831_hdfs____.b79s8w/webapp 2023-02-13 20:04:05,234 INFO [Listener at localhost/35657] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44831 2023-02-13 20:04:05,238 WARN [Listener at localhost/35657] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:04:05,238 WARN [Listener at localhost/35657] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:04:05,276 WARN [Listener at localhost/45879] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:04:05,289 WARN [Listener at localhost/45879] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:04:05,291 WARN [Listener at localhost/45879] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:04:05,292 INFO [Listener at localhost/45879] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:04:05,296 INFO [Listener at localhost/45879] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/java.io.tmpdir/Jetty_localhost_46497_datanode____o0urnb/webapp 2023-02-13 20:04:05,388 INFO [Listener at localhost/45879] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46497 2023-02-13 20:04:05,395 WARN [Listener at localhost/35565] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:04:05,411 WARN [Listener at localhost/35565] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:04:05,413 WARN [Listener at localhost/35565] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:04:05,414 INFO [Listener at localhost/35565] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:04:05,418 INFO [Listener at localhost/35565] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/java.io.tmpdir/Jetty_localhost_41919_datanode____yzp94b/webapp 2023-02-13 20:04:05,497 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7fa1cd641a8b9be0: Processing first storage report for DS-210d1bab-1d1c-465e-b001-3b00502b987a from datanode 6a614638-d70a-4167-b202-948f6a37de03 2023-02-13 20:04:05,497 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7fa1cd641a8b9be0: from storage DS-210d1bab-1d1c-465e-b001-3b00502b987a node DatanodeRegistration(127.0.0.1:36523, datanodeUuid=6a614638-d70a-4167-b202-948f6a37de03, infoPort=39735, infoSecurePort=0, ipcPort=35565, storageInfo=lv=-57;cid=testClusterID;nsid=488050568;c=1676318645098), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:04:05,497 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7fa1cd641a8b9be0: Processing first storage report for DS-80d7f79b-c865-4bae-b432-d982ad90ec76 from datanode 6a614638-d70a-4167-b202-948f6a37de03 2023-02-13 20:04:05,497 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7fa1cd641a8b9be0: from storage DS-80d7f79b-c865-4bae-b432-d982ad90ec76 node DatanodeRegistration(127.0.0.1:36523, datanodeUuid=6a614638-d70a-4167-b202-948f6a37de03, infoPort=39735, infoSecurePort=0, ipcPort=35565, storageInfo=lv=-57;cid=testClusterID;nsid=488050568;c=1676318645098), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:04:05,518 INFO [Listener at localhost/35565] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41919 2023-02-13 20:04:05,525 WARN [Listener at localhost/35721] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:04:05,612 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x692b7aaf1b36ab31: Processing first storage report for DS-b541b15c-55a4-493d-ad9e-52ee0a6adb8e from datanode 171746bb-180f-41e9-bb72-884f7933c055 2023-02-13 20:04:05,612 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x692b7aaf1b36ab31: from storage DS-b541b15c-55a4-493d-ad9e-52ee0a6adb8e node DatanodeRegistration(127.0.0.1:35365, datanodeUuid=171746bb-180f-41e9-bb72-884f7933c055, infoPort=42853, infoSecurePort=0, ipcPort=35721, storageInfo=lv=-57;cid=testClusterID;nsid=488050568;c=1676318645098), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:04:05,612 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x692b7aaf1b36ab31: Processing first storage report for DS-d959bdf8-dcc2-48e5-9c97-ded500fb7b9d from datanode 171746bb-180f-41e9-bb72-884f7933c055 2023-02-13 20:04:05,613 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x692b7aaf1b36ab31: from storage DS-d959bdf8-dcc2-48e5-9c97-ded500fb7b9d node DatanodeRegistration(127.0.0.1:35365, datanodeUuid=171746bb-180f-41e9-bb72-884f7933c055, infoPort=42853, infoSecurePort=0, ipcPort=35721, storageInfo=lv=-57;cid=testClusterID;nsid=488050568;c=1676318645098), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:04:05,635 DEBUG [Listener at localhost/35721] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809 2023-02-13 20:04:05,637 INFO [Listener at localhost/35721] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/cluster_509b7b7e-ade4-cffe-62ef-01ce8c214228/zookeeper_0, clientPort=62111, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/cluster_509b7b7e-ade4-cffe-62ef-01ce8c214228/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/cluster_509b7b7e-ade4-cffe-62ef-01ce8c214228/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 20:04:05,640 INFO [Listener at localhost/35721] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62111 2023-02-13 20:04:05,640 INFO [Listener at localhost/35721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:05,641 INFO [Listener at localhost/35721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:05,661 INFO [Listener at localhost/35721] util.FSUtils(479): Created version file at hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0 with version=8 2023-02-13 20:04:05,661 INFO [Listener at localhost/35721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:05,662 INFO [Listener at localhost/35721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:05,663 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45879/user/jenkins/test-data/686a11ed-dd0a-f1c2-20e7-fe60840000f9/hbase-staging 2023-02-13 20:04:05,665 INFO [Listener at localhost/35721] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:04:05,665 INFO [Listener at localhost/35721] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:05,665 INFO [Listener at localhost/35721] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:05,665 INFO [Listener at localhost/35721] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:04:05,665 INFO [Listener at localhost/35721] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:05,665 INFO [Listener at localhost/35721] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:04:05,665 INFO [Listener at localhost/35721] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:04:05,667 INFO [Listener at localhost/35721] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39521 2023-02-13 20:04:05,667 INFO [Listener at localhost/35721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:05,668 INFO [Listener at localhost/35721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:05,669 INFO [Listener at localhost/35721] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39521 connecting to ZooKeeper ensemble=127.0.0.1:62111 2023-02-13 20:04:05,679 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:395210x0, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:04:05,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39521-0x1004f4887490000 connected 2023-02-13 20:04:05,703 DEBUG [Listener at localhost/35721] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:04:05,703 DEBUG [Listener at localhost/35721] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:05,703 DEBUG [Listener at localhost/35721] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:04:05,708 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39521 2023-02-13 20:04:05,708 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39521 2023-02-13 20:04:05,708 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39521 2023-02-13 20:04:05,709 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39521 2023-02-13 20:04:05,709 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39521 2023-02-13 20:04:05,709 INFO [Listener at localhost/35721] master.HMaster(439): hbase.rootdir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0, hbase.cluster.distributed=false 2023-02-13 20:04:05,721 INFO [Listener at localhost/35721] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:04:05,721 INFO [Listener at localhost/35721] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:05,721 INFO [Listener at localhost/35721] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:05,721 INFO [Listener at localhost/35721] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:04:05,721 INFO [Listener at localhost/35721] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:05,721 INFO [Listener at localhost/35721] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:04:05,721 INFO [Listener at localhost/35721] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:04:05,722 INFO [Listener at localhost/35721] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45171 2023-02-13 20:04:05,722 INFO [Listener at localhost/35721] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:04:05,727 DEBUG [Listener at localhost/35721] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:04:05,727 INFO [Listener at localhost/35721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:05,728 INFO [Listener at localhost/35721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:05,729 INFO [Listener at localhost/35721] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45171 connecting to ZooKeeper ensemble=127.0.0.1:62111 2023-02-13 20:04:05,731 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:451710x0, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:04:05,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45171-0x1004f4887490001 connected 2023-02-13 20:04:05,732 DEBUG [Listener at localhost/35721] zookeeper.ZKUtil(164): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:04:05,732 DEBUG [Listener at localhost/35721] zookeeper.ZKUtil(164): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:05,733 DEBUG [Listener at localhost/35721] zookeeper.ZKUtil(164): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:04:05,736 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45171 2023-02-13 20:04:05,736 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45171 2023-02-13 20:04:05,739 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45171 2023-02-13 20:04:05,740 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45171 2023-02-13 20:04:05,740 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45171 2023-02-13 20:04:05,750 INFO [Listener at localhost/35721] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:04:05,750 INFO [Listener at localhost/35721] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:05,751 INFO [Listener at localhost/35721] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:05,751 INFO [Listener at localhost/35721] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:04:05,751 INFO [Listener at localhost/35721] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:05,751 INFO [Listener at localhost/35721] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:04:05,751 INFO [Listener at localhost/35721] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:04:05,751 INFO [Listener at localhost/35721] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40887 2023-02-13 20:04:05,752 INFO [Listener at localhost/35721] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:04:05,752 DEBUG [Listener at localhost/35721] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:04:05,753 INFO [Listener at localhost/35721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:05,754 INFO [Listener at localhost/35721] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:05,755 INFO [Listener at localhost/35721] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40887 connecting to ZooKeeper ensemble=127.0.0.1:62111 2023-02-13 20:04:05,757 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:408870x0, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:04:05,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40887-0x1004f4887490002 connected 2023-02-13 20:04:05,758 DEBUG [Listener at localhost/35721] zookeeper.ZKUtil(164): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:04:05,758 DEBUG [Listener at localhost/35721] zookeeper.ZKUtil(164): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:05,759 DEBUG [Listener at localhost/35721] zookeeper.ZKUtil(164): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:04:05,760 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40887 2023-02-13 20:04:05,761 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40887 2023-02-13 20:04:05,761 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40887 2023-02-13 20:04:05,763 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40887 2023-02-13 20:04:05,763 DEBUG [Listener at localhost/35721] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40887 2023-02-13 20:04:05,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39521,1676318645664 2023-02-13 20:04:05,770 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:04:05,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39521,1676318645664 2023-02-13 20:04:05,772 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:04:05,772 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:04:05,772 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:04:05,774 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:05,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:04:05,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39521,1676318645664 from backup master directory 2023-02-13 20:04:05,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:04:05,778 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39521,1676318645664 2023-02-13 20:04:05,778 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:04:05,778 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:04:05,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,39521,1676318645664 2023-02-13 20:04:05,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/hbase.id with ID: 6a3ad693-5930-4477-90cf-e2930fa29be5 2023-02-13 20:04:05,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:05,806 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:05,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x39e041d4 to 127.0.0.1:62111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:05,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ba6d730, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:05,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:04:05,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 20:04:05,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:04:05,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/MasterData/data/master/store-tmp 2023-02-13 20:04:05,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:05,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:04:05,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:05,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:05,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:04:05,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:05,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:05,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318645835Disabling compacts and flushes for region at 1676318645835Disabling writes for close at 1676318645835Writing region close event to WAL at 1676318645835Closed at 1676318645835 2023-02-13 20:04:05,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/MasterData/WALs/jenkins-hbase4.apache.org,39521,1676318645664 2023-02-13 20:04:05,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39521%2C1676318645664, suffix=, logDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/MasterData/WALs/jenkins-hbase4.apache.org,39521,1676318645664, archiveDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/MasterData/oldWALs, maxLogs=10 2023-02-13 20:04:05,849 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35365,DS-b541b15c-55a4-493d-ad9e-52ee0a6adb8e,DISK] 2023-02-13 20:04:05,849 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36523,DS-210d1bab-1d1c-465e-b001-3b00502b987a,DISK] 2023-02-13 20:04:05,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/MasterData/WALs/jenkins-hbase4.apache.org,39521,1676318645664/jenkins-hbase4.apache.org%2C39521%2C1676318645664.1676318645837 2023-02-13 20:04:05,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35365,DS-b541b15c-55a4-493d-ad9e-52ee0a6adb8e,DISK], DatanodeInfoWithStorage[127.0.0.1:36523,DS-210d1bab-1d1c-465e-b001-3b00502b987a,DISK]] 2023-02-13 20:04:05,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:04:05,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:05,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:05,851 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:05,852 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:05,854 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 20:04:05,854 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 20:04:05,854 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:05,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:05,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:05,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:05,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:04:05,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66825043, jitterRate=-0.004229262471199036}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:04:05,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676318645851Initializing all the Stores at 1676318645852 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318645852Cleaning up temporary data from old regions at 1676318645856 (+4 ms)Cleaning up detritus from prior splits at 1676318645856Region opened successfully at 1676318645859 (+3 ms) 2023-02-13 20:04:05,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 20:04:05,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 20:04:05,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 20:04:05,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 20:04:05,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 20:04:05,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 20:04:05,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 20:04:05,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 20:04:05,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 20:04:05,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 20:04:05,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 20:04:05,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 20:04:05,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 20:04:05,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 20:04:05,921 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:05,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 20:04:05,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 20:04:05,922 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 20:04:05,923 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:05,923 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:05,923 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:05,923 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:05,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,39521,1676318645664, sessionid=0x1004f4887490000, setting cluster-up flag (Was=false) 2023-02-13 20:04:05,928 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:05,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 20:04:05,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39521,1676318645664 2023-02-13 20:04:05,936 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:05,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 20:04:05,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39521,1676318645664 2023-02-13 20:04:05,941 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.hbase-snapshot/.tmp 2023-02-13 20:04:05,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 20:04:05,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:04:05,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:04:05,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:04:05,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:04:05,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 20:04:05,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:05,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:04:05,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:05,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676318675945 2023-02-13 20:04:05,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 20:04:05,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 20:04:05,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 20:04:05,945 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:04:05,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 20:04:05,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 20:04:05,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 20:04:05,945 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 20:04:05,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:05,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 20:04:05,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 20:04:05,946 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 20:04:05,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 20:04:05,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 20:04:05,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318645947,5,FailOnTimeoutGroup] 2023-02-13 20:04:05,947 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:04:05,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318645947,5,FailOnTimeoutGroup] 2023-02-13 20:04:05,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:05,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 20:04:05,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:05,947 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:05,955 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:04:05,955 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:04:05,956 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0 2023-02-13 20:04:05,964 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:05,967 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:04:05,967 INFO [RS:0;jenkins-hbase4:45171] regionserver.HRegionServer(952): ClusterId : 6a3ad693-5930-4477-90cf-e2930fa29be5 2023-02-13 20:04:05,967 INFO [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(952): ClusterId : 6a3ad693-5930-4477-90cf-e2930fa29be5 2023-02-13 20:04:05,967 DEBUG [RS:0;jenkins-hbase4:45171] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:04:05,968 DEBUG [RS:1;jenkins-hbase4:40887] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:04:05,968 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/info 2023-02-13 20:04:05,968 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:04:05,969 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:05,969 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:04:05,970 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:04:05,970 DEBUG [RS:0;jenkins-hbase4:45171] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:04:05,970 DEBUG [RS:0;jenkins-hbase4:45171] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:04:05,970 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:04:05,970 DEBUG [RS:1;jenkins-hbase4:40887] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:04:05,970 DEBUG [RS:1;jenkins-hbase4:40887] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:04:05,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:05,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:04:05,972 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/table 2023-02-13 20:04:05,972 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:04:05,972 DEBUG [RS:0;jenkins-hbase4:45171] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:04:05,973 DEBUG [RS:0;jenkins-hbase4:45171] zookeeper.ReadOnlyZKClient(139): Connect 0x3ce56d36 to 127.0.0.1:62111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:05,973 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:05,973 DEBUG [RS:1;jenkins-hbase4:40887] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:04:05,974 DEBUG [RS:1;jenkins-hbase4:40887] zookeeper.ReadOnlyZKClient(139): Connect 0x64d790e4 to 127.0.0.1:62111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:05,975 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740 2023-02-13 20:04:05,975 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740 2023-02-13 20:04:05,977 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:04:05,978 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:04:05,979 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:04:05,979 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64606208, jitterRate=-0.03729248046875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:04:05,980 DEBUG [RS:0;jenkins-hbase4:45171] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@322294da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:05,980 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676318645964Initializing all the Stores at 1676318645964Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318645964Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318645966 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318645966Cleaning up temporary data from old regions at 1676318645976 (+10 ms)Cleaning up detritus from prior splits at 1676318645976Region opened successfully at 1676318645980 (+4 ms) 2023-02-13 20:04:05,980 DEBUG [RS:0;jenkins-hbase4:45171] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@361d0646, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:04:05,980 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:04:05,980 DEBUG [RS:1;jenkins-hbase4:40887] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a10720e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:05,980 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:04:05,980 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:04:05,980 DEBUG [RS:1;jenkins-hbase4:40887] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e2ffb94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:04:05,980 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:04:05,980 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:04:05,981 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:04:05,981 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318645980Disabling compacts and flushes for region at 1676318645980Disabling writes for close at 1676318645980Writing region close event to WAL at 1676318645981 (+1 ms)Closed at 1676318645981 2023-02-13 20:04:05,982 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:04:05,982 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 20:04:05,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 20:04:05,983 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 20:04:05,984 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 20:04:05,990 DEBUG [RS:0;jenkins-hbase4:45171] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45171 2023-02-13 20:04:05,990 INFO [RS:0;jenkins-hbase4:45171] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:04:05,990 INFO [RS:0;jenkins-hbase4:45171] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:04:05,990 DEBUG [RS:0;jenkins-hbase4:45171] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:04:05,991 INFO [RS:0;jenkins-hbase4:45171] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39521,1676318645664 with isa=jenkins-hbase4.apache.org/172.31.14.131:45171, startcode=1676318645720 2023-02-13 20:04:05,991 DEBUG [RS:0;jenkins-hbase4:45171] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:04:05,992 DEBUG [RS:1;jenkins-hbase4:40887] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40887 2023-02-13 20:04:05,992 INFO [RS:1;jenkins-hbase4:40887] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:04:05,992 INFO [RS:1;jenkins-hbase4:40887] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:04:05,992 DEBUG [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:04:05,993 INFO [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39521,1676318645664 with isa=jenkins-hbase4.apache.org/172.31.14.131:40887, startcode=1676318645750 2023-02-13 20:04:05,993 DEBUG [RS:1;jenkins-hbase4:40887] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:04:05,993 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50265, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:04:05,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:05,996 DEBUG [RS:0;jenkins-hbase4:45171] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0 2023-02-13 20:04:05,996 DEBUG [RS:0;jenkins-hbase4:45171] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45879 2023-02-13 20:04:05,996 DEBUG [RS:0;jenkins-hbase4:45171] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:04:05,996 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54571, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:04:05,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:05,997 DEBUG [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0 2023-02-13 20:04:05,997 DEBUG [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45879 2023-02-13 20:04:05,997 DEBUG [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:04:05,997 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:05,997 DEBUG [RS:0;jenkins-hbase4:45171] zookeeper.ZKUtil(162): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:05,998 WARN [RS:0;jenkins-hbase4:45171] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:04:05,998 INFO [RS:0;jenkins-hbase4:45171] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:04:05,998 DEBUG [RS:0;jenkins-hbase4:45171] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/WALs/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:06,001 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40887,1676318645750] 2023-02-13 20:04:06,002 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45171,1676318645720] 2023-02-13 20:04:06,002 DEBUG [RS:1;jenkins-hbase4:40887] zookeeper.ZKUtil(162): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:06,002 WARN [RS:1;jenkins-hbase4:40887] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:04:06,002 INFO [RS:1;jenkins-hbase4:40887] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:04:06,002 DEBUG [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/WALs/jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:06,005 DEBUG [RS:0;jenkins-hbase4:45171] zookeeper.ZKUtil(162): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:06,005 DEBUG [RS:0;jenkins-hbase4:45171] zookeeper.ZKUtil(162): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:06,006 DEBUG [RS:1;jenkins-hbase4:40887] zookeeper.ZKUtil(162): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:06,006 DEBUG [RS:1;jenkins-hbase4:40887] zookeeper.ZKUtil(162): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:06,006 DEBUG [RS:0;jenkins-hbase4:45171] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:04:06,006 INFO [RS:0;jenkins-hbase4:45171] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:04:06,012 INFO [RS:0;jenkins-hbase4:45171] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:04:06,012 DEBUG [RS:1;jenkins-hbase4:40887] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:04:06,012 INFO [RS:0;jenkins-hbase4:45171] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:04:06,012 INFO [RS:0;jenkins-hbase4:45171] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,012 INFO [RS:1;jenkins-hbase4:40887] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:04:06,013 INFO [RS:0;jenkins-hbase4:45171] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:04:06,014 INFO [RS:0;jenkins-hbase4:45171] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,014 DEBUG [RS:0;jenkins-hbase4:45171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,014 DEBUG [RS:0;jenkins-hbase4:45171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,015 DEBUG [RS:0;jenkins-hbase4:45171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,015 DEBUG [RS:0;jenkins-hbase4:45171] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,015 DEBUG [RS:0;jenkins-hbase4:45171] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,015 DEBUG [RS:0;jenkins-hbase4:45171] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:04:06,015 DEBUG [RS:0;jenkins-hbase4:45171] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,015 DEBUG [RS:0;jenkins-hbase4:45171] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,015 DEBUG [RS:0;jenkins-hbase4:45171] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,015 DEBUG [RS:0;jenkins-hbase4:45171] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,016 INFO [RS:1;jenkins-hbase4:40887] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:04:06,020 INFO [RS:1;jenkins-hbase4:40887] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:04:06,021 INFO [RS:1;jenkins-hbase4:40887] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,021 INFO [RS:0;jenkins-hbase4:45171] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,021 INFO [RS:0;jenkins-hbase4:45171] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,021 INFO [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:04:06,021 INFO [RS:0;jenkins-hbase4:45171] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,025 INFO [RS:1;jenkins-hbase4:40887] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,026 DEBUG [RS:1;jenkins-hbase4:40887] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,026 DEBUG [RS:1;jenkins-hbase4:40887] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,026 DEBUG [RS:1;jenkins-hbase4:40887] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,026 DEBUG [RS:1;jenkins-hbase4:40887] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,026 DEBUG [RS:1;jenkins-hbase4:40887] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,026 DEBUG [RS:1;jenkins-hbase4:40887] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:04:06,026 DEBUG [RS:1;jenkins-hbase4:40887] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,026 DEBUG [RS:1;jenkins-hbase4:40887] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,026 DEBUG [RS:1;jenkins-hbase4:40887] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,026 DEBUG [RS:1;jenkins-hbase4:40887] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:06,029 INFO [RS:1;jenkins-hbase4:40887] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,029 INFO [RS:1;jenkins-hbase4:40887] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,030 INFO [RS:1;jenkins-hbase4:40887] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,038 INFO [RS:0;jenkins-hbase4:45171] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:04:06,038 INFO [RS:0;jenkins-hbase4:45171] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45171,1676318645720-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,045 INFO [RS:1;jenkins-hbase4:40887] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:04:06,045 INFO [RS:1;jenkins-hbase4:40887] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40887,1676318645750-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,051 INFO [RS:0;jenkins-hbase4:45171] regionserver.Replication(203): jenkins-hbase4.apache.org,45171,1676318645720 started 2023-02-13 20:04:06,051 INFO [RS:0;jenkins-hbase4:45171] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45171,1676318645720, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45171, sessionid=0x1004f4887490001 2023-02-13 20:04:06,051 DEBUG [RS:0;jenkins-hbase4:45171] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:04:06,051 DEBUG [RS:0;jenkins-hbase4:45171] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:06,051 DEBUG [RS:0;jenkins-hbase4:45171] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45171,1676318645720' 2023-02-13 20:04:06,051 DEBUG [RS:0;jenkins-hbase4:45171] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:06,052 DEBUG [RS:0;jenkins-hbase4:45171] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:06,052 DEBUG [RS:0;jenkins-hbase4:45171] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:04:06,052 DEBUG [RS:0;jenkins-hbase4:45171] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:04:06,052 DEBUG [RS:0;jenkins-hbase4:45171] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:06,052 DEBUG [RS:0;jenkins-hbase4:45171] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45171,1676318645720' 2023-02-13 20:04:06,052 DEBUG [RS:0;jenkins-hbase4:45171] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:06,052 DEBUG [RS:0;jenkins-hbase4:45171] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:06,052 DEBUG [RS:0;jenkins-hbase4:45171] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:04:06,053 INFO [RS:0;jenkins-hbase4:45171] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:04:06,053 INFO [RS:0;jenkins-hbase4:45171] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:04:06,056 INFO [RS:1;jenkins-hbase4:40887] regionserver.Replication(203): jenkins-hbase4.apache.org,40887,1676318645750 started 2023-02-13 20:04:06,056 INFO [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40887,1676318645750, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40887, sessionid=0x1004f4887490002 2023-02-13 20:04:06,056 DEBUG [RS:1;jenkins-hbase4:40887] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:04:06,056 DEBUG [RS:1;jenkins-hbase4:40887] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:06,056 DEBUG [RS:1;jenkins-hbase4:40887] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40887,1676318645750' 2023-02-13 20:04:06,056 DEBUG [RS:1;jenkins-hbase4:40887] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:06,056 DEBUG [RS:1;jenkins-hbase4:40887] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:06,056 DEBUG [RS:1;jenkins-hbase4:40887] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:04:06,057 DEBUG [RS:1;jenkins-hbase4:40887] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:04:06,057 DEBUG [RS:1;jenkins-hbase4:40887] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:06,057 DEBUG [RS:1;jenkins-hbase4:40887] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40887,1676318645750' 2023-02-13 20:04:06,057 DEBUG [RS:1;jenkins-hbase4:40887] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:06,057 DEBUG [RS:1;jenkins-hbase4:40887] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:06,057 DEBUG [RS:1;jenkins-hbase4:40887] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:04:06,057 INFO [RS:1;jenkins-hbase4:40887] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:04:06,057 INFO [RS:1;jenkins-hbase4:40887] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:04:06,135 DEBUG [jenkins-hbase4:39521] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 20:04:06,135 DEBUG [jenkins-hbase4:39521] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:04:06,136 DEBUG [jenkins-hbase4:39521] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:04:06,137 DEBUG [jenkins-hbase4:39521] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:04:06,137 DEBUG [jenkins-hbase4:39521] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:04:06,137 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40887,1676318645750, state=OPENING 2023-02-13 20:04:06,138 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 20:04:06,139 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:06,140 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:04:06,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40887,1676318645750}] 2023-02-13 20:04:06,295 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:06,295 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 20:04:06,297 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40806, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 20:04:06,301 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 20:04:06,301 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:04:06,302 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40887%2C1676318645750.meta, suffix=.meta, logDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/WALs/jenkins-hbase4.apache.org,40887,1676318645750, archiveDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/oldWALs, maxLogs=32 2023-02-13 20:04:06,315 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36523,DS-210d1bab-1d1c-465e-b001-3b00502b987a,DISK] 2023-02-13 20:04:06,315 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35365,DS-b541b15c-55a4-493d-ad9e-52ee0a6adb8e,DISK] 2023-02-13 20:04:06,317 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/WALs/jenkins-hbase4.apache.org,40887,1676318645750/jenkins-hbase4.apache.org%2C40887%2C1676318645750.meta.1676318646302.meta 2023-02-13 20:04:06,317 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36523,DS-210d1bab-1d1c-465e-b001-3b00502b987a,DISK], DatanodeInfoWithStorage[127.0.0.1:35365,DS-b541b15c-55a4-493d-ad9e-52ee0a6adb8e,DISK]] 2023-02-13 20:04:06,317 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:04:06,317 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 20:04:06,317 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 20:04:06,317 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 20:04:06,317 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 20:04:06,317 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:06,317 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 20:04:06,317 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 20:04:06,318 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:04:06,319 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/info 2023-02-13 20:04:06,319 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/info 2023-02-13 20:04:06,319 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:04:06,320 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:06,320 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:04:06,321 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:04:06,321 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:04:06,321 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:04:06,321 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:06,321 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:04:06,322 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/table 2023-02-13 20:04:06,322 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/table 2023-02-13 20:04:06,322 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:04:06,323 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:06,323 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740 2023-02-13 20:04:06,324 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740 2023-02-13 20:04:06,325 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:04:06,326 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:04:06,327 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73910351, jitterRate=0.10135005414485931}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:04:06,327 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676318646318Writing region info on filesystem at 1676318646318Initializing all the Stores at 1676318646318Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318646318Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318646318Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318646318Cleaning up temporary data from old regions at 1676318646324 (+6 ms)Cleaning up detritus from prior splits at 1676318646325 (+1 ms)Running coprocessor post-open hooks at 1676318646327 (+2 ms)Region opened successfully at 1676318646327 2023-02-13 20:04:06,327 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676318646295 2023-02-13 20:04:06,331 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 20:04:06,332 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 20:04:06,332 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40887,1676318645750, state=OPEN 2023-02-13 20:04:06,333 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 20:04:06,333 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:04:06,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 20:04:06,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40887,1676318645750 in 193 msec 2023-02-13 20:04:06,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 20:04:06,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-13 20:04:06,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 395 msec 2023-02-13 20:04:06,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676318645770, completionTime=-1 2023-02-13 20:04:06,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 20:04:06,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 20:04:06,339 DEBUG [hconnection-0x577863e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:04:06,340 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40814, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:04:06,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 20:04:06,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676318706342 2023-02-13 20:04:06,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676318766342 2023-02-13 20:04:06,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-13 20:04:06,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39521,1676318645664-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39521,1676318645664-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39521,1676318645664-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39521, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:06,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 20:04:06,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:04:06,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 20:04:06,355 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 20:04:06,356 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:04:06,356 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:04:06,358 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/hbase/namespace/45c4d49b79fb5f2f64e7a1748d02d04a 2023-02-13 20:04:06,358 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/hbase/namespace/45c4d49b79fb5f2f64e7a1748d02d04a empty. 2023-02-13 20:04:06,359 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/hbase/namespace/45c4d49b79fb5f2f64e7a1748d02d04a 2023-02-13 20:04:06,359 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 20:04:06,366 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 20:04:06,367 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 45c4d49b79fb5f2f64e7a1748d02d04a, NAME => 'hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp 2023-02-13 20:04:06,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:06,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 45c4d49b79fb5f2f64e7a1748d02d04a, disabling compactions & flushes 2023-02-13 20:04:06,374 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. 2023-02-13 20:04:06,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. 2023-02-13 20:04:06,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. after waiting 0 ms 2023-02-13 20:04:06,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. 2023-02-13 20:04:06,374 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. 2023-02-13 20:04:06,374 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 45c4d49b79fb5f2f64e7a1748d02d04a: Waiting for close lock at 1676318646374Disabling compacts and flushes for region at 1676318646374Disabling writes for close at 1676318646374Writing region close event to WAL at 1676318646374Closed at 1676318646374 2023-02-13 20:04:06,376 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:04:06,377 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318646376"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318646376"}]},"ts":"1676318646376"} 2023-02-13 20:04:06,378 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 20:04:06,378 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:04:06,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318646379"}]},"ts":"1676318646379"} 2023-02-13 20:04:06,380 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 20:04:06,384 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:04:06,384 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:04:06,384 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:04:06,384 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:04:06,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=45c4d49b79fb5f2f64e7a1748d02d04a, ASSIGN}] 2023-02-13 20:04:06,387 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=45c4d49b79fb5f2f64e7a1748d02d04a, ASSIGN 2023-02-13 20:04:06,388 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=45c4d49b79fb5f2f64e7a1748d02d04a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40887,1676318645750; forceNewPlan=false, retain=false 2023-02-13 20:04:06,538 INFO [jenkins-hbase4:39521] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 20:04:06,539 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=45c4d49b79fb5f2f64e7a1748d02d04a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:06,539 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318646538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318646538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318646538"}]},"ts":"1676318646538"} 2023-02-13 20:04:06,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 45c4d49b79fb5f2f64e7a1748d02d04a, server=jenkins-hbase4.apache.org,40887,1676318645750}] 2023-02-13 20:04:06,695 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. 2023-02-13 20:04:06,697 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40887%2C1676318645750, suffix=, logDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/WALs/jenkins-hbase4.apache.org,40887,1676318645750, archiveDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/oldWALs, maxLogs=32 2023-02-13 20:04:06,709 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35365,DS-b541b15c-55a4-493d-ad9e-52ee0a6adb8e,DISK] 2023-02-13 20:04:06,709 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36523,DS-210d1bab-1d1c-465e-b001-3b00502b987a,DISK] 2023-02-13 20:04:06,710 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/WALs/jenkins-hbase4.apache.org,40887,1676318645750/jenkins-hbase4.apache.org%2C40887%2C1676318645750.1676318646697 2023-02-13 20:04:06,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35365,DS-b541b15c-55a4-493d-ad9e-52ee0a6adb8e,DISK], DatanodeInfoWithStorage[127.0.0.1:36523,DS-210d1bab-1d1c-465e-b001-3b00502b987a,DISK]] 2023-02-13 20:04:06,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 45c4d49b79fb5f2f64e7a1748d02d04a, NAME => 'hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:04:06,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 45c4d49b79fb5f2f64e7a1748d02d04a 2023-02-13 20:04:06,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:06,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 45c4d49b79fb5f2f64e7a1748d02d04a 2023-02-13 20:04:06,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 45c4d49b79fb5f2f64e7a1748d02d04a 2023-02-13 20:04:06,712 INFO [StoreOpener-45c4d49b79fb5f2f64e7a1748d02d04a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 45c4d49b79fb5f2f64e7a1748d02d04a 2023-02-13 20:04:06,713 DEBUG [StoreOpener-45c4d49b79fb5f2f64e7a1748d02d04a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/namespace/45c4d49b79fb5f2f64e7a1748d02d04a/info 2023-02-13 20:04:06,713 DEBUG [StoreOpener-45c4d49b79fb5f2f64e7a1748d02d04a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/namespace/45c4d49b79fb5f2f64e7a1748d02d04a/info 2023-02-13 20:04:06,713 INFO [StoreOpener-45c4d49b79fb5f2f64e7a1748d02d04a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45c4d49b79fb5f2f64e7a1748d02d04a columnFamilyName info 2023-02-13 20:04:06,714 INFO [StoreOpener-45c4d49b79fb5f2f64e7a1748d02d04a-1] regionserver.HStore(310): Store=45c4d49b79fb5f2f64e7a1748d02d04a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:06,714 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/namespace/45c4d49b79fb5f2f64e7a1748d02d04a 2023-02-13 20:04:06,714 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/namespace/45c4d49b79fb5f2f64e7a1748d02d04a 2023-02-13 20:04:06,719 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 45c4d49b79fb5f2f64e7a1748d02d04a 2023-02-13 20:04:06,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/namespace/45c4d49b79fb5f2f64e7a1748d02d04a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:04:06,721 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 45c4d49b79fb5f2f64e7a1748d02d04a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70930789, jitterRate=0.056951120495796204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:04:06,721 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 45c4d49b79fb5f2f64e7a1748d02d04a: Running coprocessor pre-open hook at 1676318646711Writing region info on filesystem at 1676318646711Initializing all the Stores at 1676318646712 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318646712Cleaning up temporary data from old regions at 1676318646715 (+3 ms)Cleaning up detritus from prior splits at 1676318646715Running coprocessor post-open hooks at 1676318646721 (+6 ms)Region opened successfully at 1676318646721 2023-02-13 20:04:06,722 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a., pid=6, masterSystemTime=1676318646692 2023-02-13 20:04:06,723 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. 2023-02-13 20:04:06,723 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. 2023-02-13 20:04:06,724 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=45c4d49b79fb5f2f64e7a1748d02d04a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:06,724 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318646724"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318646724"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318646724"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318646724"}]},"ts":"1676318646724"} 2023-02-13 20:04:06,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 20:04:06,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 45c4d49b79fb5f2f64e7a1748d02d04a, server=jenkins-hbase4.apache.org,40887,1676318645750 in 184 msec 2023-02-13 20:04:06,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 20:04:06,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=45c4d49b79fb5f2f64e7a1748d02d04a, ASSIGN in 341 msec 2023-02-13 20:04:06,728 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:04:06,728 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318646728"}]},"ts":"1676318646728"} 2023-02-13 20:04:06,730 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 20:04:06,732 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:04:06,733 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 378 msec 2023-02-13 20:04:06,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 20:04:06,757 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:04:06,757 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:06,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 20:04:06,767 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:04:06,769 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-13 20:04:06,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 20:04:06,778 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:04:06,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-13 20:04:06,785 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 20:04:06,787 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 20:04:06,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.008sec 2023-02-13 20:04:06,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 20:04:06,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 20:04:06,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 20:04:06,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39521,1676318645664-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 20:04:06,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39521,1676318645664-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 20:04:06,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 20:04:06,868 DEBUG [Listener at localhost/35721] zookeeper.ReadOnlyZKClient(139): Connect 0x18e4dd99 to 127.0.0.1:62111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:06,871 DEBUG [Listener at localhost/35721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@125dbe12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:06,872 DEBUG [hconnection-0x3300eeae-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:04:06,874 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40826, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:04:06,875 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39521,1676318645664 2023-02-13 20:04:06,875 DEBUG [Listener at localhost/35721] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 20:04:06,877 DEBUG [Listener at localhost/35721] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 20:04:06,879 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43736, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 20:04:06,879 INFO [Listener at localhost/35721] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:06,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:06,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 20:04:06,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 103 connection: 172.31.14.131:43736 deadline: 1676318706879, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:06,880 INFO [Listener at localhost/35721] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 20:04:06,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:04:06,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:06,884 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:04:06,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-13 20:04:06,884 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:04:06,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:04:06,886 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:06,886 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de empty. 2023-02-13 20:04:06,886 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:06,886 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-13 20:04:06,894 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-13 20:04:06,895 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 05ebae0c69cf766789d1eba8621210de, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp 2023-02-13 20:04:06,902 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:06,902 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 05ebae0c69cf766789d1eba8621210de, disabling compactions & flushes 2023-02-13 20:04:06,902 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:06,902 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:06,902 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. after waiting 0 ms 2023-02-13 20:04:06,902 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:06,902 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:06,902 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 05ebae0c69cf766789d1eba8621210de: Waiting for close lock at 1676318646902Disabling compacts and flushes for region at 1676318646902Disabling writes for close at 1676318646902Writing region close event to WAL at 1676318646902Closed at 1676318646902 2023-02-13 20:04:06,904 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:04:06,905 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676318646905"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318646905"}]},"ts":"1676318646905"} 2023-02-13 20:04:06,906 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 20:04:06,906 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:04:06,907 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318646906"}]},"ts":"1676318646906"} 2023-02-13 20:04:06,907 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-13 20:04:06,911 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:04:06,912 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:04:06,912 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:04:06,912 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:04:06,913 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=05ebae0c69cf766789d1eba8621210de, ASSIGN}] 2023-02-13 20:04:06,914 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=05ebae0c69cf766789d1eba8621210de, ASSIGN 2023-02-13 20:04:06,915 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=05ebae0c69cf766789d1eba8621210de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45171,1676318645720; forceNewPlan=false, retain=false 2023-02-13 20:04:06,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:04:07,054 INFO [RS:0;jenkins-hbase4:45171] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45171%2C1676318645720, suffix=, logDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/WALs/jenkins-hbase4.apache.org,45171,1676318645720, archiveDir=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/oldWALs, maxLogs=32 2023-02-13 20:04:07,065 INFO [jenkins-hbase4:39521] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 20:04:07,065 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=05ebae0c69cf766789d1eba8621210de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,067 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676318647065"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318647065"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318647065"}]},"ts":"1676318647065"} 2023-02-13 20:04:07,069 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35365,DS-b541b15c-55a4-493d-ad9e-52ee0a6adb8e,DISK] 2023-02-13 20:04:07,069 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36523,DS-210d1bab-1d1c-465e-b001-3b00502b987a,DISK] 2023-02-13 20:04:07,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 05ebae0c69cf766789d1eba8621210de, server=jenkins-hbase4.apache.org,45171,1676318645720}] 2023-02-13 20:04:07,071 INFO [RS:0;jenkins-hbase4:45171] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/WALs/jenkins-hbase4.apache.org,45171,1676318645720/jenkins-hbase4.apache.org%2C45171%2C1676318645720.1676318647054 2023-02-13 20:04:07,071 DEBUG [RS:0;jenkins-hbase4:45171] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35365,DS-b541b15c-55a4-493d-ad9e-52ee0a6adb8e,DISK], DatanodeInfoWithStorage[127.0.0.1:36523,DS-210d1bab-1d1c-465e-b001-3b00502b987a,DISK]] 2023-02-13 20:04:07,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:04:07,192 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 20:04:07,223 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,223 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 20:04:07,226 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47886, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 20:04:07,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:07,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 05ebae0c69cf766789d1eba8621210de, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:04:07,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:07,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:07,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:07,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:07,234 INFO [StoreOpener-05ebae0c69cf766789d1eba8621210de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:07,236 DEBUG [StoreOpener-05ebae0c69cf766789d1eba8621210de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1 2023-02-13 20:04:07,236 DEBUG [StoreOpener-05ebae0c69cf766789d1eba8621210de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1 2023-02-13 20:04:07,237 INFO [StoreOpener-05ebae0c69cf766789d1eba8621210de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05ebae0c69cf766789d1eba8621210de columnFamilyName f1 2023-02-13 20:04:07,237 INFO [StoreOpener-05ebae0c69cf766789d1eba8621210de-1] regionserver.HStore(310): Store=05ebae0c69cf766789d1eba8621210de/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:07,237 INFO [StoreOpener-05ebae0c69cf766789d1eba8621210de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:07,238 DEBUG [StoreOpener-05ebae0c69cf766789d1eba8621210de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2 2023-02-13 20:04:07,239 DEBUG [StoreOpener-05ebae0c69cf766789d1eba8621210de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2 2023-02-13 20:04:07,239 INFO [StoreOpener-05ebae0c69cf766789d1eba8621210de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05ebae0c69cf766789d1eba8621210de columnFamilyName f2 2023-02-13 20:04:07,239 INFO [StoreOpener-05ebae0c69cf766789d1eba8621210de-1] regionserver.HStore(310): Store=05ebae0c69cf766789d1eba8621210de/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:07,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:07,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:07,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:04:07,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:07,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:04:07,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 05ebae0c69cf766789d1eba8621210de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61599227, jitterRate=-0.08209998905658722}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:04:07,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 05ebae0c69cf766789d1eba8621210de: Running coprocessor pre-open hook at 1676318647232Writing region info on filesystem at 1676318647232Initializing all the Stores at 1676318647234 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318647234Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318647234Cleaning up temporary data from old regions at 1676318647241 (+7 ms)Cleaning up detritus from prior splits at 1676318647242 (+1 ms)Running coprocessor post-open hooks at 1676318647248 (+6 ms)Region opened successfully at 1676318647248 2023-02-13 20:04:07,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de., pid=12, masterSystemTime=1676318647223 2023-02-13 20:04:07,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:07,253 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=05ebae0c69cf766789d1eba8621210de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,254 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676318647253"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318647253"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318647253"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318647253"}]},"ts":"1676318647253"} 2023-02-13 20:04:07,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:07,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 20:04:07,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 05ebae0c69cf766789d1eba8621210de, server=jenkins-hbase4.apache.org,45171,1676318645720 in 186 msec 2023-02-13 20:04:07,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 20:04:07,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=05ebae0c69cf766789d1eba8621210de, ASSIGN in 346 msec 2023-02-13 20:04:07,260 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:04:07,260 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318647260"}]},"ts":"1676318647260"} 2023-02-13 20:04:07,261 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-13 20:04:07,264 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:04:07,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 382 msec 2023-02-13 20:04:07,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:04:07,489 INFO [Listener at localhost/35721] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-13 20:04:07,489 DEBUG [Listener at localhost/35721] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-13 20:04:07,490 INFO [Listener at localhost/35721] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:04:07,491 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-13 20:04:07,492 INFO [Listener at localhost/35721] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:04:07,492 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-13 20:04:07,492 INFO [Listener at localhost/35721] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 20:04:07,503 DEBUG [hconnection-0x3300eeae-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:04:07,515 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47894, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:04:07,523 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45171] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:07,604 INFO [Listener at localhost/35721] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 20:04:07,604 INFO [Listener at localhost/35721] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 20:04:07,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 20:04:07,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676318647605 (current time:1676318647605). 2023-02-13 20:04:07,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 20:04:07,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(139): Connect 0x5d5f7103 to 127.0.0.1:62111 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:07,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28d4f466, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:07,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:04:07,611 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40828, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:04:07,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d5f7103 to 127.0.0.1:62111 2023-02-13 20:04:07,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:07,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 20:04:07,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 20:04:07,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 20:04:07,615 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 20:04:07,615 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676319247615 2023-02-13 20:04:07,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 20:04:07,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:07,617 DEBUG [Listener at localhost/35721] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 20:04:07,618 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 20:04:07,618 DEBUG [Listener at localhost/35721] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 20:04:07,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 20:04:07,619 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-13 20:04:07,619 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 20:04:07,620 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676319247620 2023-02-13 20:04:07,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-13 20:04:07,627 INFO [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-13 20:04:07,627 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:04:07,628 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-13 20:04:07,628 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-13 20:04:07,628 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,628 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-13 20:04:07,630 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:04:07,630 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:04:07,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:04:07,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:04:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:07,630 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:07,631 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 20:04:07,631 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:04:07,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 20:04:07,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 20:04:07,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 20:04:07,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 20:04:07,632 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-13 20:04:07,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 20:04:07,632 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-13 20:04:07,632 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 20:04:07,632 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 20:04:07,632 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 20:04:07,632 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:04:07,633 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 20:04:07,633 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 20:04:07,633 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 20:04:07,633 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45171,1676318645720' joining acquired barrier for procedure (foo) in zk 2023-02-13 20:04:07,633 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:04:07,633 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 20:04:07,633 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 20:04:07,634 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40887,1676318645750' joining acquired barrier for procedure (foo) in zk 2023-02-13 20:04:07,635 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,635 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 20:04:07,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:07,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:04:07,635 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 20:04:07,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:07,635 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 20:04:07,636 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:04:07,636 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 20:04:07,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:07,636 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:04:07,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 20:04:07,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:07,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:07,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45171,1676318645720' joining acquired barrier for procedure 'foo' on coordinator 2023-02-13 20:04:07,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58500802[Count = 0] remaining members to acquire global barrier 2023-02-13 20:04:07,637 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-13 20:04:07,637 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-13 20:04:07,638 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 20:04:07,638 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 20:04:07,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 20:04:07,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 20:04:07,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 20:04:07,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 20:04:07,638 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 20:04:07,639 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 20:04:07,639 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 20:04:07,639 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,40887,1676318645750' in zk 2023-02-13 20:04:07,638 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,639 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 20:04:07,639 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 20:04:07,639 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:04:07,639 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:07,639 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. started... 2023-02-13 20:04:07,639 INFO [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 05ebae0c69cf766789d1eba8621210de 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 20:04:07,641 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 20:04:07,641 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:07,641 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 20:04:07,659 INFO [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/.tmp/f1/33e342b509fc42e7b8954efc5a0ff83d 2023-02-13 20:04:07,680 INFO [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/.tmp/f2/45ae18bec64d46cfaa1f2d487566d15a 2023-02-13 20:04:07,684 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/.tmp/f1/33e342b509fc42e7b8954efc5a0ff83d as hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1/33e342b509fc42e7b8954efc5a0ff83d 2023-02-13 20:04:07,687 INFO [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1/33e342b509fc42e7b8954efc5a0ff83d, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 20:04:07,688 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/.tmp/f2/45ae18bec64d46cfaa1f2d487566d15a as hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2/45ae18bec64d46cfaa1f2d487566d15a 2023-02-13 20:04:07,691 INFO [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2/45ae18bec64d46cfaa1f2d487566d15a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 20:04:07,692 INFO [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 05ebae0c69cf766789d1eba8621210de in 53ms, sequenceid=5, compaction requested=false 2023-02-13 20:04:07,692 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 20:04:07,692 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 05ebae0c69cf766789d1eba8621210de: 2023-02-13 20:04:07,692 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.' region-info for snapshot=foo 2023-02-13 20:04:07,692 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:04:07,692 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1/33e342b509fc42e7b8954efc5a0ff83d] hfiles 2023-02-13 20:04:07,692 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1/33e342b509fc42e7b8954efc5a0ff83d for snapshot=foo 2023-02-13 20:04:07,692 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2/45ae18bec64d46cfaa1f2d487566d15a] hfiles 2023-02-13 20:04:07,692 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2/45ae18bec64d46cfaa1f2d487566d15a for snapshot=foo 2023-02-13 20:04:07,701 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. completed. 2023-02-13 20:04:07,701 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:07,701 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 20:04:07,701 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 20:04:07,701 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,701 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 20:04:07,701 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,45171,1676318645720' in zk 2023-02-13 20:04:07,702 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 20:04:07,702 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:07,702 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,702 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 20:04:07,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:07,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:04:07,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:07,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:07,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 20:04:07,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:07,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:07,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 20:04:07,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:07,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,45171,1676318645720': 2023-02-13 20:04:07,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45171,1676318645720' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-13 20:04:07,706 INFO [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-13 20:04:07,706 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:04:07,706 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:04:07,706 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-13 20:04:07,706 INFO [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 20:04:07,708 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,708 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,708 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:04:07,708 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:04:07,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,708 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:07,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:04:07,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:04:07,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:07,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:04:07,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:07,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:07,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 20:04:07,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,709 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:07,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:07,709 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 20:04:07,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:07,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:07,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 20:04:07,711 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:07,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:07,711 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,717 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,717 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:04:07,717 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:04:07,717 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:07,717 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 20:04:07,717 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-13 20:04:07,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:04:07,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-13 20:04:07,717 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:04:07,717 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:04:07,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:04:07,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:07,717 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:07,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:07,717 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 20:04:07,717 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:07,717 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 20:04:07,717 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:07,717 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 20:04:07,718 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 20:04:07,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:04:07,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:07,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.hbase-snapshot/.tmp/foo 2023-02-13 20:04:07,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:04:07,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:07,718 DEBUG [Listener at localhost/35721] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:04:07,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-13 20:04:07,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:04:07,719 DEBUG [Listener at localhost/35721] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 20:04:07,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.hbase-snapshot/.tmp/foo to hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.hbase-snapshot/foo 2023-02-13 20:04:07,748 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-13 20:04:07,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.hbase-snapshot/.tmp/foo 2023-02-13 20:04:07,748 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.hbase-snapshot/.tmp/foo 2023-02-13 20:04:07,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676318647616Consolidate snapshot: foo at 1676318647717 (+101 ms)Loading Region manifests for foo at 1676318647717Writing data manifest for foo at 1676318647720 (+3 ms)Verifying snapshot: foo at 1676318647726 (+6 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676318647748 (+22 ms) 2023-02-13 20:04:07,750 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 20:04:07,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 133 msec 2023-02-13 20:04:07,919 DEBUG [Listener at localhost/35721] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:04:07,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-13 20:04:07,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 20:04:07,921 INFO [Listener at localhost/35721] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 20:04:07,924 INFO [Listener at localhost/35721] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 20:04:07,928 INFO [Listener at localhost/35721] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 20:04:07,955 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45171] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:08,037 INFO [Listener at localhost/35721] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 20:04:08,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 20:04:08,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,043 INFO [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 20:04:08,043 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:04:08,044 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-13 20:04:08,044 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-13 20:04:08,044 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,044 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,046 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:04:08,046 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:04:08,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:04:08,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:04:08,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:08,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:08,046 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,046 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,046 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:04:08,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:04:08,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:04:08,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,047 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,047 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,047 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,047 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,048 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-13 20:04:08,048 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:04:08,048 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-13 20:04:08,048 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-13 20:04:08,049 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-13 20:04:08,049 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40887,1676318645750' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-13 20:04:08,048 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:04:08,049 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-13 20:04:08,050 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 20:04:08,050 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 20:04:08,050 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:08,050 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. started... 2023-02-13 20:04:08,050 INFO [rs(jenkins-hbase4.apache.org,45171,1676318645720)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 05ebae0c69cf766789d1eba8621210de 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 20:04:08,051 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,051 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,052 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:04:08,070 INFO [rs(jenkins-hbase4.apache.org,45171,1676318645720)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/.tmp/f1/f9c23171be534b41a4b9628e3bb31111 2023-02-13 20:04:08,089 INFO [rs(jenkins-hbase4.apache.org,45171,1676318645720)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/.tmp/f2/4f883bc2101646e4aa8809cce681bcb0 2023-02-13 20:04:08,094 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/.tmp/f1/f9c23171be534b41a4b9628e3bb31111 as hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1/f9c23171be534b41a4b9628e3bb31111 2023-02-13 20:04:08,097 INFO [rs(jenkins-hbase4.apache.org,45171,1676318645720)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1/f9c23171be534b41a4b9628e3bb31111, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 20:04:08,098 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/.tmp/f2/4f883bc2101646e4aa8809cce681bcb0 as hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2/4f883bc2101646e4aa8809cce681bcb0 2023-02-13 20:04:08,101 INFO [rs(jenkins-hbase4.apache.org,45171,1676318645720)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2/4f883bc2101646e4aa8809cce681bcb0, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 20:04:08,102 INFO [rs(jenkins-hbase4.apache.org,45171,1676318645720)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 05ebae0c69cf766789d1eba8621210de in 52ms, sequenceid=9, compaction requested=false 2023-02-13 20:04:08,104 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 05ebae0c69cf766789d1eba8621210de: 2023-02-13 20:04:08,104 DEBUG [rs(jenkins-hbase4.apache.org,45171,1676318645720)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:08,104 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 20:04:08,104 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 20:04:08,104 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,104 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-13 20:04:08,104 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45171,1676318645720' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-13 20:04:08,105 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,105 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:08,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:04:08,106 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,106 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:04:08,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:08,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:08,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:08,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:08,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45171,1676318645720' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-13 20:04:08,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c6f87d0[Count = 0] remaining members to acquire global barrier 2023-02-13 20:04:08,108 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-13 20:04:08,108 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,114 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,114 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,114 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,114 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:04:08,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,114 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-13 20:04:08,114 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-13 20:04:08,114 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-13 20:04:08,114 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-13 20:04:08,114 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,45171,1676318645720' in zk 2023-02-13 20:04:08,114 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,40887,1676318645750' in zk 2023-02-13 20:04:08,116 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:08,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:04:08,116 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-13 20:04:08,116 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-13 20:04:08,116 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:08,116 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:08,116 DEBUG [member: 'jenkins-hbase4.apache.org,40887,1676318645750' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-13 20:04:08,116 DEBUG [member: 'jenkins-hbase4.apache.org,45171,1676318645720' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-13 20:04:08,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:08,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:08,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:08,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:08,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:08,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,45171,1676318645720': 2023-02-13 20:04:08,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45171,1676318645720' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-13 20:04:08,119 INFO [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-13 20:04:08,119 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:04:08,119 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:04:08,119 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,119 INFO [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 20:04:08,120 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,120 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,120 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:04:08,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,120 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:04:08,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,121 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:04:08,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:04:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:08,121 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:08,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:04:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,121 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:08,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:08,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,123 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:08,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:08,123 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:08,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,126 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,126 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:04:08,126 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,126 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:04:08,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:04:08,126 DEBUG [(jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:08,126 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:08,126 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:04:08,126 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 20:04:08,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 20:04:08,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:08,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:04:08,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:08,126 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:04:08,126 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,127 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,127 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:08,127 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,127 DEBUG [Listener at localhost/35721] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-13 20:04:08,127 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:04:08,127 DEBUG [Listener at localhost/35721] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 20:04:08,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:04:08,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:08,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:08,227 DEBUG [Listener at localhost/35721] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 20:04:08,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 20:04:08,233 INFO [Listener at localhost/35721] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676318647605 type: FLUSH version: 2 ttl: 0 2023-02-13 20:04:08,233 DEBUG [Listener at localhost/35721] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45879/user/jenkins/test-data/686a11ed-dd0a-f1c2-20e7-fe60840000f9/foo/c4e54de6-481d-4ef8-81b0-f7fdabfdc885/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,233 INFO [Listener at localhost/35721] snapshot.RestoreSnapshotHelper(239): region to add: 05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:08,233 INFO [Listener at localhost/35721] snapshot.RestoreSnapshotHelper(585): clone region=05ebae0c69cf766789d1eba8621210de as 05ebae0c69cf766789d1eba8621210de in snapshot foo 2023-02-13 20:04:08,234 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 05ebae0c69cf766789d1eba8621210de, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45879/user/jenkins/test-data/686a11ed-dd0a-f1c2-20e7-fe60840000f9/foo/c4e54de6-481d-4ef8-81b0-f7fdabfdc885 2023-02-13 20:04:08,241 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:08,241 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 33e342b509fc42e7b8954efc5a0ff83d from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,243 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 45ae18bec64d46cfaa1f2d487566d15a from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,245 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 05ebae0c69cf766789d1eba8621210de, disabling compactions & flushes 2023-02-13 20:04:08,245 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:08,245 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:08,245 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. after waiting 0 ms 2023-02-13 20:04:08,245 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:08,245 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:08,245 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 05ebae0c69cf766789d1eba8621210de: Waiting for close lock at 1676318648245Disabling compacts and flushes for region at 1676318648245Disabling writes for close at 1676318648245Writing region close event to WAL at 1676318648245Closed at 1676318648245 2023-02-13 20:04:08,247 INFO [Listener at localhost/35721] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676318647605 type: FLUSH version: 2 ttl: 0 2023-02-13 20:04:08,247 DEBUG [Listener at localhost/35721] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45879/user/jenkins/test-data/686a11ed-dd0a-f1c2-20e7-fe60840000f9/foo/c4e54de6-481d-4ef8-81b0-f7fdabfdc885 2023-02-13 20:04:08,247 DEBUG [Listener at localhost/35721] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45879/user/jenkins/test-data/686a11ed-dd0a-f1c2-20e7-fe60840000f9/foo/c4e54de6-481d-4ef8-81b0-f7fdabfdc885 2023-02-13 20:04:08,248 DEBUG [Listener at localhost/35721] util.CommonFSUtils(699): |-data/ 2023-02-13 20:04:08,248 DEBUG [Listener at localhost/35721] util.CommonFSUtils(699): |----default/ 2023-02-13 20:04:08,248 DEBUG [Listener at localhost/35721] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-13 20:04:08,249 DEBUG [Listener at localhost/35721] util.CommonFSUtils(699): |----------05ebae0c69cf766789d1eba8621210de/ 2023-02-13 20:04:08,249 DEBUG [Listener at localhost/35721] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:04:08,249 DEBUG [Listener at localhost/35721] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:04:08,249 DEBUG [Listener at localhost/35721] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=05ebae0c69cf766789d1eba8621210de-33e342b509fc42e7b8954efc5a0ff83d 2023-02-13 20:04:08,249 DEBUG [Listener at localhost/35721] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:04:08,250 DEBUG [Listener at localhost/35721] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=05ebae0c69cf766789d1eba8621210de-45ae18bec64d46cfaa1f2d487566d15a hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1/33e342b509fc42e7b8954efc5a0ff83d hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1/f9c23171be534b41a4b9628e3bb31111 hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2/45ae18bec64d46cfaa1f2d487566d15a hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2/4f883bc2101646e4aa8809cce681bcb0 2023-02-13 20:04:08,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-13 20:04:08,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-13 20:04:08,259 INFO [Listener at localhost/35721] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 20:04:08,263 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318648263"}]},"ts":"1676318648263"} 2023-02-13 20:04:08,265 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-13 20:04:08,267 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-13 20:04:08,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=05ebae0c69cf766789d1eba8621210de, UNASSIGN}] 2023-02-13 20:04:08,270 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=05ebae0c69cf766789d1eba8621210de, UNASSIGN 2023-02-13 20:04:08,270 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=05ebae0c69cf766789d1eba8621210de, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,271 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676318648270"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318648270"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318648270"}]},"ts":"1676318648270"} 2023-02-13 20:04:08,273 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 05ebae0c69cf766789d1eba8621210de, server=jenkins-hbase4.apache.org,45171,1676318645720}] 2023-02-13 20:04:08,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 20:04:08,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:08,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 05ebae0c69cf766789d1eba8621210de, disabling compactions & flushes 2023-02-13 20:04:08,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:08,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:08,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. after waiting 0 ms 2023-02-13 20:04:08,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:08,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:04:08,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de. 2023-02-13 20:04:08,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 05ebae0c69cf766789d1eba8621210de: Waiting for close lock at 1676318648425Running coprocessor pre-close hooks at 1676318648425Disabling compacts and flushes for region at 1676318648425Disabling writes for close at 1676318648425Writing region close event to WAL at 1676318648426 (+1 ms)Running coprocessor post-close hooks at 1676318648430 (+4 ms)Closed at 1676318648431 (+1 ms) 2023-02-13 20:04:08,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:08,433 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=05ebae0c69cf766789d1eba8621210de, regionState=CLOSED 2023-02-13 20:04:08,433 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676318648433"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318648433"}]},"ts":"1676318648433"} 2023-02-13 20:04:08,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 20:04:08,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 05ebae0c69cf766789d1eba8621210de, server=jenkins-hbase4.apache.org,45171,1676318645720 in 161 msec 2023-02-13 20:04:08,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 20:04:08,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=05ebae0c69cf766789d1eba8621210de, UNASSIGN in 168 msec 2023-02-13 20:04:08,438 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318648438"}]},"ts":"1676318648438"} 2023-02-13 20:04:08,439 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-13 20:04:08,440 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-13 20:04:08,442 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 181 msec 2023-02-13 20:04:08,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 20:04:08,567 INFO [Listener at localhost/35721] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-13 20:04:08,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,570 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,570 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 20:04:08,573 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:08,575 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1, FileablePath, hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2, FileablePath, hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/recovered.edits] 2023-02-13 20:04:08,578 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1/33e342b509fc42e7b8954efc5a0ff83d to hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1/33e342b509fc42e7b8954efc5a0ff83d 2023-02-13 20:04:08,579 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1/f9c23171be534b41a4b9628e3bb31111 to hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f1/f9c23171be534b41a4b9628e3bb31111 2023-02-13 20:04:08,581 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2/45ae18bec64d46cfaa1f2d487566d15a to hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2/45ae18bec64d46cfaa1f2d487566d15a 2023-02-13 20:04:08,582 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2/4f883bc2101646e4aa8809cce681bcb0 to hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/f2/4f883bc2101646e4aa8809cce681bcb0 2023-02-13 20:04:08,584 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/recovered.edits/12.seqid to hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de/recovered.edits/12.seqid 2023-02-13 20:04:08,584 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/05ebae0c69cf766789d1eba8621210de 2023-02-13 20:04:08,584 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-13 20:04:08,586 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,588 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-13 20:04:08,589 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-13 20:04:08,593 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,593 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-13 20:04:08,593 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318648593"}]},"ts":"9223372036854775807"} 2023-02-13 20:04:08,594 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 20:04:08,594 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 05ebae0c69cf766789d1eba8621210de, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676318646882.05ebae0c69cf766789d1eba8621210de.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 20:04:08,594 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-13 20:04:08,594 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676318648594"}]},"ts":"9223372036854775807"} 2023-02-13 20:04:08,595 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-13 20:04:08,596 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 20:04:08,597 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 29 msec 2023-02-13 20:04:08,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39521] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 20:04:08,672 INFO [Listener at localhost/35721] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-13 20:04:08,673 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 20:04:08,673 INFO [Listener at localhost/35721] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 20:04:08,673 DEBUG [Listener at localhost/35721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18e4dd99 to 127.0.0.1:62111 2023-02-13 20:04:08,673 DEBUG [Listener at localhost/35721] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:08,673 DEBUG [Listener at localhost/35721] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 20:04:08,673 DEBUG [Listener at localhost/35721] util.JVMClusterUtil(257): Found active master hash=1246230307, stopped=false 2023-02-13 20:04:08,673 INFO [Listener at localhost/35721] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39521,1676318645664 2023-02-13 20:04:08,676 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:08,676 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:08,676 INFO [Listener at localhost/35721] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 20:04:08,676 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:08,676 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:08,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:08,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:08,678 DEBUG [Listener at localhost/35721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39e041d4 to 127.0.0.1:62111 2023-02-13 20:04:08,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:08,678 DEBUG [Listener at localhost/35721] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:08,678 INFO [Listener at localhost/35721] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45171,1676318645720' ***** 2023-02-13 20:04:08,678 INFO [Listener at localhost/35721] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:04:08,678 INFO [Listener at localhost/35721] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40887,1676318645750' ***** 2023-02-13 20:04:08,678 INFO [Listener at localhost/35721] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:04:08,678 INFO [RS:1;jenkins-hbase4:40887] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:04:08,679 INFO [RS:0;jenkins-hbase4:45171] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:04:08,679 INFO [RS:1;jenkins-hbase4:40887] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:04:08,679 INFO [RS:0;jenkins-hbase4:45171] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:04:08,679 INFO [RS:0;jenkins-hbase4:45171] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:04:08,679 INFO [RS:1;jenkins-hbase4:40887] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:04:08,679 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:04:08,679 INFO [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(3304): Received CLOSE for 45c4d49b79fb5f2f64e7a1748d02d04a 2023-02-13 20:04:08,679 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:04:08,679 INFO [RS:0;jenkins-hbase4:45171] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,680 DEBUG [RS:0;jenkins-hbase4:45171] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ce56d36 to 127.0.0.1:62111 2023-02-13 20:04:08,681 INFO [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:08,681 DEBUG [RS:0;jenkins-hbase4:45171] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:08,681 DEBUG [RS:1;jenkins-hbase4:40887] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64d790e4 to 127.0.0.1:62111 2023-02-13 20:04:08,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 45c4d49b79fb5f2f64e7a1748d02d04a, disabling compactions & flushes 2023-02-13 20:04:08,681 DEBUG [RS:1;jenkins-hbase4:40887] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:08,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. 2023-02-13 20:04:08,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. 2023-02-13 20:04:08,681 INFO [RS:0;jenkins-hbase4:45171] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45171,1676318645720; all regions closed. 2023-02-13 20:04:08,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. after waiting 0 ms 2023-02-13 20:04:08,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. 2023-02-13 20:04:08,681 INFO [RS:1;jenkins-hbase4:40887] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:04:08,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 45c4d49b79fb5f2f64e7a1748d02d04a 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 20:04:08,681 INFO [RS:1;jenkins-hbase4:40887] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:04:08,682 INFO [RS:1;jenkins-hbase4:40887] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:04:08,682 INFO [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 20:04:08,682 INFO [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-13 20:04:08,682 DEBUG [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 45c4d49b79fb5f2f64e7a1748d02d04a=hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a.} 2023-02-13 20:04:08,682 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:04:08,682 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:04:08,682 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:04:08,682 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:04:08,682 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:04:08,682 DEBUG [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(1505): Waiting on 1588230740, 45c4d49b79fb5f2f64e7a1748d02d04a 2023-02-13 20:04:08,682 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-13 20:04:08,687 DEBUG [RS:0;jenkins-hbase4:45171] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/oldWALs 2023-02-13 20:04:08,687 INFO [RS:0;jenkins-hbase4:45171] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45171%2C1676318645720:(num 1676318647054) 2023-02-13 20:04:08,687 DEBUG [RS:0;jenkins-hbase4:45171] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:08,687 INFO [RS:0;jenkins-hbase4:45171] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:04:08,687 INFO [RS:0;jenkins-hbase4:45171] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 20:04:08,687 INFO [RS:0;jenkins-hbase4:45171] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:04:08,688 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:04:08,688 INFO [RS:0;jenkins-hbase4:45171] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:04:08,688 INFO [RS:0;jenkins-hbase4:45171] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:04:08,689 INFO [RS:0;jenkins-hbase4:45171] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45171 2023-02-13 20:04:08,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/namespace/45c4d49b79fb5f2f64e7a1748d02d04a/.tmp/info/9ee4d147ef9040e0a1cdc97d6ba132d2 2023-02-13 20:04:08,693 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/.tmp/info/5458ca3005f6474d9ebbda8fdcd71e8b 2023-02-13 20:04:08,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/namespace/45c4d49b79fb5f2f64e7a1748d02d04a/.tmp/info/9ee4d147ef9040e0a1cdc97d6ba132d2 as hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/namespace/45c4d49b79fb5f2f64e7a1748d02d04a/info/9ee4d147ef9040e0a1cdc97d6ba132d2 2023-02-13 20:04:08,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5458ca3005f6474d9ebbda8fdcd71e8b 2023-02-13 20:04:08,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/namespace/45c4d49b79fb5f2f64e7a1748d02d04a/info/9ee4d147ef9040e0a1cdc97d6ba132d2, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 20:04:08,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 45c4d49b79fb5f2f64e7a1748d02d04a in 22ms, sequenceid=6, compaction requested=false 2023-02-13 20:04:08,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/namespace/45c4d49b79fb5f2f64e7a1748d02d04a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 20:04:08,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. 2023-02-13 20:04:08,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 45c4d49b79fb5f2f64e7a1748d02d04a: Waiting for close lock at 1676318648681Running coprocessor pre-close hooks at 1676318648681Disabling compacts and flushes for region at 1676318648681Disabling writes for close at 1676318648681Obtaining lock to block concurrent updates at 1676318648682 (+1 ms)Preparing flush snapshotting stores in 45c4d49b79fb5f2f64e7a1748d02d04a at 1676318648682Finished memstore snapshotting hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676318648682Flushing stores of hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. at 1676318648682Flushing 45c4d49b79fb5f2f64e7a1748d02d04a/info: creating writer at 1676318648682Flushing 45c4d49b79fb5f2f64e7a1748d02d04a/info: appending metadata at 1676318648685 (+3 ms)Flushing 45c4d49b79fb5f2f64e7a1748d02d04a/info: closing flushed file at 1676318648685Flushing 45c4d49b79fb5f2f64e7a1748d02d04a/info: reopening flushed file at 1676318648699 (+14 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 45c4d49b79fb5f2f64e7a1748d02d04a in 22ms, sequenceid=6, compaction requested=false at 1676318648703 (+4 ms)Writing region close event to WAL at 1676318648703Running coprocessor post-close hooks at 1676318648706 (+3 ms)Closed at 1676318648707 (+1 ms) 2023-02-13 20:04:08,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676318646354.45c4d49b79fb5f2f64e7a1748d02d04a. 2023-02-13 20:04:08,708 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/.tmp/rep_barrier/7a75c8d0b9644a8693667a6db22be1e5 2023-02-13 20:04:08,711 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a75c8d0b9644a8693667a6db22be1e5 2023-02-13 20:04:08,718 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/.tmp/table/55f2a37bebfa4366a6eb9cd6960a90a8 2023-02-13 20:04:08,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55f2a37bebfa4366a6eb9cd6960a90a8 2023-02-13 20:04:08,721 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/.tmp/info/5458ca3005f6474d9ebbda8fdcd71e8b as hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/info/5458ca3005f6474d9ebbda8fdcd71e8b 2023-02-13 20:04:08,724 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5458ca3005f6474d9ebbda8fdcd71e8b 2023-02-13 20:04:08,725 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/info/5458ca3005f6474d9ebbda8fdcd71e8b, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 20:04:08,725 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/.tmp/rep_barrier/7a75c8d0b9644a8693667a6db22be1e5 as hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/rep_barrier/7a75c8d0b9644a8693667a6db22be1e5 2023-02-13 20:04:08,726 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:04:08,729 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a75c8d0b9644a8693667a6db22be1e5 2023-02-13 20:04:08,729 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/rep_barrier/7a75c8d0b9644a8693667a6db22be1e5, entries=1, sequenceid=21, filesize=5.1 K 2023-02-13 20:04:08,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/.tmp/table/55f2a37bebfa4366a6eb9cd6960a90a8 as hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/table/55f2a37bebfa4366a6eb9cd6960a90a8 2023-02-13 20:04:08,733 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:04:08,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55f2a37bebfa4366a6eb9cd6960a90a8 2023-02-13 20:04:08,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/table/55f2a37bebfa4366a6eb9cd6960a90a8, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 20:04:08,735 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=21, compaction requested=false 2023-02-13 20:04:08,735 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 20:04:08,739 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 20:04:08,739 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 20:04:08,740 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:04:08,740 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318648682Running coprocessor pre-close hooks at 1676318648682Disabling compacts and flushes for region at 1676318648682Disabling writes for close at 1676318648682Obtaining lock to block concurrent updates at 1676318648682Preparing flush snapshotting stores in 1588230740 at 1676318648682Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676318648682Flushing stores of hbase:meta,,1.1588230740 at 1676318648683 (+1 ms)Flushing 1588230740/info: creating writer at 1676318648683Flushing 1588230740/info: appending metadata at 1676318648685 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676318648685Flushing 1588230740/rep_barrier: creating writer at 1676318648698 (+13 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676318648700 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676318648700Flushing 1588230740/table: creating writer at 1676318648711 (+11 ms)Flushing 1588230740/table: appending metadata at 1676318648713 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676318648713Flushing 1588230740/info: reopening flushed file at 1676318648722 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676318648726 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676318648730 (+4 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=21, compaction requested=false at 1676318648735 (+5 ms)Writing region close event to WAL at 1676318648736 (+1 ms)Running coprocessor post-close hooks at 1676318648739 (+3 ms)Closed at 1676318648740 (+1 ms) 2023-02-13 20:04:08,740 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 20:04:08,784 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,784 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:08,784 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45171,1676318645720 2023-02-13 20:04:08,784 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:08,784 ERROR [Listener at localhost/35721-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@fc8c79f rejected from java.util.concurrent.ThreadPoolExecutor@bf752be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:08,784 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:08,784 ERROR [Listener at localhost/35721-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@364c5cfd rejected from java.util.concurrent.ThreadPoolExecutor@bf752be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:08,786 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45171,1676318645720] 2023-02-13 20:04:08,786 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45171,1676318645720; numProcessing=1 2023-02-13 20:04:08,787 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45171,1676318645720 already deleted, retry=false 2023-02-13 20:04:08,787 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45171,1676318645720 expired; onlineServers=1 2023-02-13 20:04:08,882 INFO [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40887,1676318645750; all regions closed. 2023-02-13 20:04:08,889 DEBUG [RS:1;jenkins-hbase4:40887] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/oldWALs 2023-02-13 20:04:08,889 INFO [RS:1;jenkins-hbase4:40887] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40887%2C1676318645750.meta:.meta(num 1676318646302) 2023-02-13 20:04:08,892 DEBUG [RS:1;jenkins-hbase4:40887] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/oldWALs 2023-02-13 20:04:08,893 INFO [RS:1;jenkins-hbase4:40887] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40887%2C1676318645750:(num 1676318646697) 2023-02-13 20:04:08,893 DEBUG [RS:1;jenkins-hbase4:40887] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:08,893 INFO [RS:1;jenkins-hbase4:40887] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:04:08,893 INFO [RS:1;jenkins-hbase4:40887] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 20:04:08,893 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:04:08,894 INFO [RS:1;jenkins-hbase4:40887] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40887 2023-02-13 20:04:08,895 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40887,1676318645750 2023-02-13 20:04:08,895 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:08,895 ERROR [Listener at localhost/35721-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7efe035 rejected from java.util.concurrent.ThreadPoolExecutor@3d07410[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:08,896 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40887,1676318645750] 2023-02-13 20:04:08,896 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40887,1676318645750; numProcessing=2 2023-02-13 20:04:08,898 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40887,1676318645750 already deleted, retry=false 2023-02-13 20:04:08,898 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40887,1676318645750 expired; onlineServers=0 2023-02-13 20:04:08,898 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39521,1676318645664' ***** 2023-02-13 20:04:08,899 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 20:04:08,899 DEBUG [M:0;jenkins-hbase4:39521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e787ab3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:04:08,899 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39521,1676318645664 2023-02-13 20:04:08,899 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39521,1676318645664; all regions closed. 2023-02-13 20:04:08,899 DEBUG [M:0;jenkins-hbase4:39521] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:08,899 DEBUG [M:0;jenkins-hbase4:39521] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 20:04:08,900 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 20:04:08,900 DEBUG [M:0;jenkins-hbase4:39521] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 20:04:08,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318645947] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318645947,5,FailOnTimeoutGroup] 2023-02-13 20:04:08,900 INFO [M:0;jenkins-hbase4:39521] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 20:04:08,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318645947] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318645947,5,FailOnTimeoutGroup] 2023-02-13 20:04:08,900 INFO [M:0;jenkins-hbase4:39521] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 20:04:08,901 INFO [M:0;jenkins-hbase4:39521] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 20:04:08,901 DEBUG [M:0;jenkins-hbase4:39521] master.HMaster(1502): Stopping service threads 2023-02-13 20:04:08,901 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 20:04:08,901 INFO [M:0;jenkins-hbase4:39521] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 20:04:08,901 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:08,902 ERROR [M:0;jenkins-hbase4:39521] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 20:04:08,902 INFO [M:0;jenkins-hbase4:39521] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 20:04:08,902 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 20:04:08,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:04:08,902 DEBUG [M:0;jenkins-hbase4:39521] zookeeper.ZKUtil(398): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 20:04:08,902 WARN [M:0;jenkins-hbase4:39521] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 20:04:08,902 INFO [M:0;jenkins-hbase4:39521] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 20:04:08,903 INFO [M:0;jenkins-hbase4:39521] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 20:04:08,903 DEBUG [M:0;jenkins-hbase4:39521] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:04:08,903 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:08,903 DEBUG [M:0;jenkins-hbase4:39521] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:08,903 DEBUG [M:0;jenkins-hbase4:39521] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:04:08,903 DEBUG [M:0;jenkins-hbase4:39521] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:08,903 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.63 KB heapSize=67.59 KB 2023-02-13 20:04:08,912 INFO [M:0;jenkins-hbase4:39521] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.63 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d3a56dc81170401c8df490e8cc109e5b 2023-02-13 20:04:08,916 DEBUG [M:0;jenkins-hbase4:39521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d3a56dc81170401c8df490e8cc109e5b as hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d3a56dc81170401c8df490e8cc109e5b 2023-02-13 20:04:08,919 INFO [M:0;jenkins-hbase4:39521] regionserver.HStore(1080): Added hdfs://localhost:45879/user/jenkins/test-data/1aaca138-c5c6-5dd7-5f47-6f7da9be70a0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d3a56dc81170401c8df490e8cc109e5b, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 20:04:08,920 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegion(2947): Finished flush of dataSize ~56.63 KB/57989, heapSize ~67.57 KB/69192, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-13 20:04:08,920 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:08,920 DEBUG [M:0;jenkins-hbase4:39521] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318648903Disabling compacts and flushes for region at 1676318648903Disabling writes for close at 1676318648903Obtaining lock to block concurrent updates at 1676318648903Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676318648903Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57989, getHeapSize=69192, getOffHeapSize=0, getCellsCount=145 at 1676318648903Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676318648904 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676318648904Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676318648906 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676318648906Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676318648916 (+10 ms)Finished flush of dataSize ~56.63 KB/57989, heapSize ~67.57 KB/69192, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1676318648920 (+4 ms)Writing region close event to WAL at 1676318648920Closed at 1676318648920 2023-02-13 20:04:08,922 INFO [M:0;jenkins-hbase4:39521] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 20:04:08,922 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:04:08,923 INFO [M:0;jenkins-hbase4:39521] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39521 2023-02-13 20:04:08,925 DEBUG [M:0;jenkins-hbase4:39521] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39521,1676318645664 already deleted, retry=false 2023-02-13 20:04:08,984 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:08,984 INFO [RS:0;jenkins-hbase4:45171] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45171,1676318645720; zookeeper connection closed. 2023-02-13 20:04:08,984 ERROR [Listener at localhost/35721-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e224e66 rejected from java.util.concurrent.ThreadPoolExecutor@bf752be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:08,984 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:45171-0x1004f4887490001, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:08,984 ERROR [Listener at localhost/35721-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7aa52879 rejected from java.util.concurrent.ThreadPoolExecutor@bf752be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:08,984 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5fb228a5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5fb228a5 2023-02-13 20:04:09,184 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:09,184 INFO [M:0;jenkins-hbase4:39521] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39521,1676318645664; zookeeper connection closed. 2023-02-13 20:04:09,184 ERROR [Listener at localhost/35721-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5a880cae rejected from java.util.concurrent.ThreadPoolExecutor@5eb78327[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:09,185 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): master:39521-0x1004f4887490000, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:09,185 ERROR [Listener at localhost/35721-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@301358e4 rejected from java.util.concurrent.ThreadPoolExecutor@5eb78327[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:09,285 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:09,285 INFO [RS:1;jenkins-hbase4:40887] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40887,1676318645750; zookeeper connection closed. 2023-02-13 20:04:09,285 ERROR [Listener at localhost/35721-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@f483eab rejected from java.util.concurrent.ThreadPoolExecutor@3d07410[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:09,285 DEBUG [Listener at localhost/35721-EventThread] zookeeper.ZKWatcher(600): regionserver:40887-0x1004f4887490002, quorum=127.0.0.1:62111, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:09,285 ERROR [Listener at localhost/35721-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@772e0330 rejected from java.util.concurrent.ThreadPoolExecutor@3d07410[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:09,285 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2c37767b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2c37767b 2023-02-13 20:04:09,285 INFO [Listener at localhost/35721] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 20:04:09,285 WARN [Listener at localhost/35721] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:04:09,289 INFO [Listener at localhost/35721] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:04:09,390 WARN [BP-2055068052-172.31.14.131-1676318645098 heartbeating to localhost/127.0.0.1:45879] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 20:04:09,390 WARN [BP-2055068052-172.31.14.131-1676318645098 heartbeating to localhost/127.0.0.1:45879] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2055068052-172.31.14.131-1676318645098 (Datanode Uuid 171746bb-180f-41e9-bb72-884f7933c055) service to localhost/127.0.0.1:45879 2023-02-13 20:04:09,394 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/cluster_509b7b7e-ade4-cffe-62ef-01ce8c214228/dfs/data/data3/current/BP-2055068052-172.31.14.131-1676318645098] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:09,394 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/cluster_509b7b7e-ade4-cffe-62ef-01ce8c214228/dfs/data/data4/current/BP-2055068052-172.31.14.131-1676318645098] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:09,395 WARN [Listener at localhost/35721] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:04:09,398 INFO [Listener at localhost/35721] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:04:09,502 WARN [BP-2055068052-172.31.14.131-1676318645098 heartbeating to localhost/127.0.0.1:45879] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 20:04:09,502 WARN [BP-2055068052-172.31.14.131-1676318645098 heartbeating to localhost/127.0.0.1:45879] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2055068052-172.31.14.131-1676318645098 (Datanode Uuid 6a614638-d70a-4167-b202-948f6a37de03) service to localhost/127.0.0.1:45879 2023-02-13 20:04:09,503 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/cluster_509b7b7e-ade4-cffe-62ef-01ce8c214228/dfs/data/data1/current/BP-2055068052-172.31.14.131-1676318645098] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:09,504 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/cluster_509b7b7e-ade4-cffe-62ef-01ce8c214228/dfs/data/data2/current/BP-2055068052-172.31.14.131-1676318645098] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:09,514 INFO [Listener at localhost/35721] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:04:09,627 INFO [Listener at localhost/35721] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 20:04:09,640 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 20:04:09,652 INFO [Listener at localhost/35721] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=272 (was 253) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35721 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45879 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:45879 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:45879 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:45879 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39521,1676318645664)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:45879 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:45879 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:45879 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=582 (was 654), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=319 (was 312) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=1425 (was 1465) 2023-02-13 20:04:09,663 INFO [Listener at localhost/35721] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=272, OpenFileDescriptor=582, MaxFileDescriptor=60000, SystemLoadAverage=319, ProcessCount=166, AvailableMemoryMB=1425 2023-02-13 20:04:09,673 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/hadoop.log.dir so I do NOT create it in target/test-data/2437a015-d035-ce37-e64b-a18b6037954e 2023-02-13 20:04:09,673 WARN [Listener at localhost/35721] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 20:04:09,673 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/hadoop.tmp.dir so I do NOT create it in target/test-data/2437a015-d035-ce37-e64b-a18b6037954e 2023-02-13 20:04:09,673 WARN [Listener at localhost/35721] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b109a052-b996-3d27-a647-eb6222f54809/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 20:04:09,673 DEBUG [Listener at localhost/35721] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e 2023-02-13 20:04:09,674 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 20:04:09,674 INFO [Listener at localhost/35721] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/cluster_4a7dd576-706a-84ab-1843-da8ad116c65c, deleteOnExit=true 2023-02-13 20:04:09,674 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 20:04:09,674 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/test.cache.data in system properties and HBase conf 2023-02-13 20:04:09,674 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 20:04:09,674 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/hadoop.log.dir in system properties and HBase conf 2023-02-13 20:04:09,674 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 20:04:09,674 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 20:04:09,674 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 20:04:09,674 DEBUG [Listener at localhost/35721] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 20:04:09,675 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:04:09,675 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 20:04:09,675 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 20:04:09,675 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:04:09,675 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 20:04:09,675 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 20:04:09,675 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 20:04:09,675 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:04:09,675 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 20:04:09,675 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/nfs.dump.dir in system properties and HBase conf 2023-02-13 20:04:09,675 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/java.io.tmpdir in system properties and HBase conf 2023-02-13 20:04:09,676 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 20:04:09,676 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 20:04:09,676 INFO [Listener at localhost/35721] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 20:04:09,680 WARN [Listener at localhost/35721] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:04:09,680 WARN [Listener at localhost/35721] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:04:09,718 WARN [Listener at localhost/35721] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:04:09,719 INFO [Listener at localhost/35721] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:04:09,723 INFO [Listener at localhost/35721] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/java.io.tmpdir/Jetty_localhost_42249_hdfs____.8iltul/webapp 2023-02-13 20:04:09,814 INFO [Listener at localhost/35721] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42249 2023-02-13 20:04:09,818 WARN [Listener at localhost/35721] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 20:04:09,818 WARN [Listener at localhost/35721] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 20:04:09,860 WARN [Listener at localhost/34861] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:04:09,875 WARN [Listener at localhost/34861] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:04:09,878 WARN [Listener at localhost/34861] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:04:09,879 INFO [Listener at localhost/34861] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:04:09,885 INFO [Listener at localhost/34861] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/java.io.tmpdir/Jetty_localhost_37489_datanode____.857adk/webapp 2023-02-13 20:04:09,979 INFO [Listener at localhost/34861] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37489 2023-02-13 20:04:09,998 WARN [Listener at localhost/42251] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:04:10,015 WARN [Listener at localhost/42251] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 20:04:10,017 WARN [Listener at localhost/42251] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 20:04:10,018 INFO [Listener at localhost/42251] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 20:04:10,021 INFO [Listener at localhost/42251] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/java.io.tmpdir/Jetty_localhost_42265_datanode____.sb6fdy/webapp 2023-02-13 20:04:10,103 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x42d411362317454e: Processing first storage report for DS-5896ff6c-cd97-40f2-bcc2-95369af0b85c from datanode a62fdac7-9799-4e8e-ad28-506bd7851daf 2023-02-13 20:04:10,103 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x42d411362317454e: from storage DS-5896ff6c-cd97-40f2-bcc2-95369af0b85c node DatanodeRegistration(127.0.0.1:38345, datanodeUuid=a62fdac7-9799-4e8e-ad28-506bd7851daf, infoPort=38391, infoSecurePort=0, ipcPort=42251, storageInfo=lv=-57;cid=testClusterID;nsid=1194297690;c=1676318649682), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:04:10,103 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x42d411362317454e: Processing first storage report for DS-49203001-2f62-4e49-89c8-8863ec7a093d from datanode a62fdac7-9799-4e8e-ad28-506bd7851daf 2023-02-13 20:04:10,103 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x42d411362317454e: from storage DS-49203001-2f62-4e49-89c8-8863ec7a093d node DatanodeRegistration(127.0.0.1:38345, datanodeUuid=a62fdac7-9799-4e8e-ad28-506bd7851daf, infoPort=38391, infoSecurePort=0, ipcPort=42251, storageInfo=lv=-57;cid=testClusterID;nsid=1194297690;c=1676318649682), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:04:10,119 INFO [Listener at localhost/42251] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42265 2023-02-13 20:04:10,136 WARN [Listener at localhost/33573] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 20:04:10,222 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2de0df8c13e6a2f7: Processing first storage report for DS-4195a749-6f54-46eb-a526-75c02377018c from datanode 9f5bcb0e-11a5-402b-94d3-500761990d9e 2023-02-13 20:04:10,222 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2de0df8c13e6a2f7: from storage DS-4195a749-6f54-46eb-a526-75c02377018c node DatanodeRegistration(127.0.0.1:42183, datanodeUuid=9f5bcb0e-11a5-402b-94d3-500761990d9e, infoPort=41209, infoSecurePort=0, ipcPort=33573, storageInfo=lv=-57;cid=testClusterID;nsid=1194297690;c=1676318649682), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:04:10,222 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2de0df8c13e6a2f7: Processing first storage report for DS-984e7fb5-fc7a-4297-9fe8-384ff279de43 from datanode 9f5bcb0e-11a5-402b-94d3-500761990d9e 2023-02-13 20:04:10,222 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2de0df8c13e6a2f7: from storage DS-984e7fb5-fc7a-4297-9fe8-384ff279de43 node DatanodeRegistration(127.0.0.1:42183, datanodeUuid=9f5bcb0e-11a5-402b-94d3-500761990d9e, infoPort=41209, infoSecurePort=0, ipcPort=33573, storageInfo=lv=-57;cid=testClusterID;nsid=1194297690;c=1676318649682), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 20:04:10,242 DEBUG [Listener at localhost/33573] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e 2023-02-13 20:04:10,244 INFO [Listener at localhost/33573] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/cluster_4a7dd576-706a-84ab-1843-da8ad116c65c/zookeeper_0, clientPort=61635, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/cluster_4a7dd576-706a-84ab-1843-da8ad116c65c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/cluster_4a7dd576-706a-84ab-1843-da8ad116c65c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 20:04:10,245 INFO [Listener at localhost/33573] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61635 2023-02-13 20:04:10,245 INFO [Listener at localhost/33573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:10,246 INFO [Listener at localhost/33573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:10,260 INFO [Listener at localhost/33573] util.FSUtils(479): Created version file at hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227 with version=8 2023-02-13 20:04:10,260 INFO [Listener at localhost/33573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:10,261 INFO [Listener at localhost/33573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:10,262 INFO [Listener at localhost/33573] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34861/user/jenkins/test-data/570a6248-b114-07a1-0c6f-635e7ccb23ba/hbase-staging 2023-02-13 20:04:10,263 INFO [Listener at localhost/33573] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:04:10,263 INFO [Listener at localhost/33573] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:10,263 INFO [Listener at localhost/33573] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:10,264 INFO [Listener at localhost/33573] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:04:10,264 INFO [Listener at localhost/33573] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:10,264 INFO [Listener at localhost/33573] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:04:10,264 INFO [Listener at localhost/33573] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:04:10,266 INFO [Listener at localhost/33573] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33867 2023-02-13 20:04:10,266 INFO [Listener at localhost/33573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:10,267 INFO [Listener at localhost/33573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:10,268 INFO [Listener at localhost/33573] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33867 connecting to ZooKeeper ensemble=127.0.0.1:61635 2023-02-13 20:04:10,274 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:338670x0, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:04:10,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33867-0x1004f4899480000 connected 2023-02-13 20:04:10,291 DEBUG [Listener at localhost/33573] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:04:10,291 DEBUG [Listener at localhost/33573] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:10,291 DEBUG [Listener at localhost/33573] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:04:10,292 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33867 2023-02-13 20:04:10,292 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33867 2023-02-13 20:04:10,296 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33867 2023-02-13 20:04:10,296 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33867 2023-02-13 20:04:10,296 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33867 2023-02-13 20:04:10,296 INFO [Listener at localhost/33573] master.HMaster(439): hbase.rootdir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227, hbase.cluster.distributed=false 2023-02-13 20:04:10,308 INFO [Listener at localhost/33573] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:04:10,308 INFO [Listener at localhost/33573] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:10,308 INFO [Listener at localhost/33573] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:10,308 INFO [Listener at localhost/33573] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:04:10,308 INFO [Listener at localhost/33573] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:10,308 INFO [Listener at localhost/33573] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:04:10,309 INFO [Listener at localhost/33573] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:04:10,309 INFO [Listener at localhost/33573] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41699 2023-02-13 20:04:10,310 INFO [Listener at localhost/33573] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:04:10,310 DEBUG [Listener at localhost/33573] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:04:10,311 INFO [Listener at localhost/33573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:10,311 INFO [Listener at localhost/33573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:10,312 INFO [Listener at localhost/33573] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41699 connecting to ZooKeeper ensemble=127.0.0.1:61635 2023-02-13 20:04:10,315 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:416990x0, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:04:10,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41699-0x1004f4899480001 connected 2023-02-13 20:04:10,317 DEBUG [Listener at localhost/33573] zookeeper.ZKUtil(164): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:04:10,318 DEBUG [Listener at localhost/33573] zookeeper.ZKUtil(164): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:10,318 DEBUG [Listener at localhost/33573] zookeeper.ZKUtil(164): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:04:10,320 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41699 2023-02-13 20:04:10,320 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41699 2023-02-13 20:04:10,320 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41699 2023-02-13 20:04:10,321 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41699 2023-02-13 20:04:10,324 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41699 2023-02-13 20:04:10,334 INFO [Listener at localhost/33573] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 20:04:10,334 INFO [Listener at localhost/33573] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:10,334 INFO [Listener at localhost/33573] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:10,334 INFO [Listener at localhost/33573] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 20:04:10,334 INFO [Listener at localhost/33573] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 20:04:10,334 INFO [Listener at localhost/33573] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 20:04:10,335 INFO [Listener at localhost/33573] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 20:04:10,335 INFO [Listener at localhost/33573] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38529 2023-02-13 20:04:10,335 INFO [Listener at localhost/33573] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 20:04:10,336 DEBUG [Listener at localhost/33573] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:04:10,336 INFO [Listener at localhost/33573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:10,337 INFO [Listener at localhost/33573] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:10,338 INFO [Listener at localhost/33573] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38529 connecting to ZooKeeper ensemble=127.0.0.1:61635 2023-02-13 20:04:10,340 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:385290x0, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 20:04:10,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38529-0x1004f4899480002 connected 2023-02-13 20:04:10,341 DEBUG [Listener at localhost/33573] zookeeper.ZKUtil(164): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:04:10,341 DEBUG [Listener at localhost/33573] zookeeper.ZKUtil(164): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:10,342 DEBUG [Listener at localhost/33573] zookeeper.ZKUtil(164): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 20:04:10,342 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38529 2023-02-13 20:04:10,344 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38529 2023-02-13 20:04:10,344 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38529 2023-02-13 20:04:10,344 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38529 2023-02-13 20:04:10,346 DEBUG [Listener at localhost/33573] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38529 2023-02-13 20:04:10,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33867,1676318650263 2023-02-13 20:04:10,350 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:04:10,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33867,1676318650263 2023-02-13 20:04:10,352 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:04:10,352 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:04:10,352 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 20:04:10,354 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:10,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:04:10,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 20:04:10,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33867,1676318650263 from backup master directory 2023-02-13 20:04:10,357 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33867,1676318650263 2023-02-13 20:04:10,357 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 20:04:10,357 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:04:10,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,33867,1676318650263 2023-02-13 20:04:10,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/hbase.id with ID: 03c1c63e-5ec9-4e1e-a8c9-27ad20aa4736 2023-02-13 20:04:10,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 20:04:10,380 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:10,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x412abb22 to 127.0.0.1:61635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:10,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c29137b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:10,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:04:10,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 20:04:10,395 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:04:10,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/MasterData/data/master/store-tmp 2023-02-13 20:04:10,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:10,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:04:10,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:10,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:10,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:04:10,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:10,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:10,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318650405Disabling compacts and flushes for region at 1676318650405Disabling writes for close at 1676318650406 (+1 ms)Writing region close event to WAL at 1676318650406Closed at 1676318650406 2023-02-13 20:04:10,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/MasterData/WALs/jenkins-hbase4.apache.org,33867,1676318650263 2023-02-13 20:04:10,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33867%2C1676318650263, suffix=, logDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/MasterData/WALs/jenkins-hbase4.apache.org,33867,1676318650263, archiveDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/MasterData/oldWALs, maxLogs=10 2023-02-13 20:04:10,426 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42183,DS-4195a749-6f54-46eb-a526-75c02377018c,DISK] 2023-02-13 20:04:10,426 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38345,DS-5896ff6c-cd97-40f2-bcc2-95369af0b85c,DISK] 2023-02-13 20:04:10,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/MasterData/WALs/jenkins-hbase4.apache.org,33867,1676318650263/jenkins-hbase4.apache.org%2C33867%2C1676318650263.1676318650408 2023-02-13 20:04:10,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42183,DS-4195a749-6f54-46eb-a526-75c02377018c,DISK], DatanodeInfoWithStorage[127.0.0.1:38345,DS-5896ff6c-cd97-40f2-bcc2-95369af0b85c,DISK]] 2023-02-13 20:04:10,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:04:10,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:10,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:10,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:10,429 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:10,430 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 20:04:10,431 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 20:04:10,431 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:10,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:10,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:10,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 20:04:10,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:04:10,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61464723, jitterRate=-0.0841042548418045}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:04:10,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676318650428Initializing all the Stores at 1676318650429 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318650429Cleaning up temporary data from old regions at 1676318650432 (+3 ms)Cleaning up detritus from prior splits at 1676318650433 (+1 ms)Region opened successfully at 1676318650436 (+3 ms) 2023-02-13 20:04:10,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 20:04:10,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 20:04:10,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 20:04:10,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 20:04:10,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 20:04:10,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 20:04:10,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 20:04:10,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 20:04:10,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 20:04:10,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 20:04:10,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 20:04:10,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 20:04:10,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 20:04:10,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 20:04:10,459 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:10,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 20:04:10,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 20:04:10,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 20:04:10,461 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:10,461 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:10,461 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:10,461 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:10,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,33867,1676318650263, sessionid=0x1004f4899480000, setting cluster-up flag (Was=false) 2023-02-13 20:04:10,467 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:10,471 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 20:04:10,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33867,1676318650263 2023-02-13 20:04:10,476 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:10,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 20:04:10,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33867,1676318650263 2023-02-13 20:04:10,481 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.hbase-snapshot/.tmp 2023-02-13 20:04:10,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 20:04:10,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:04:10,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:04:10,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:04:10,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 20:04:10,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 20:04:10,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:04:10,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676318680484 2023-02-13 20:04:10,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 20:04:10,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 20:04:10,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 20:04:10,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 20:04:10,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 20:04:10,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 20:04:10,485 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:04:10,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,485 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 20:04:10,486 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:04:10,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 20:04:10,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 20:04:10,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 20:04:10,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 20:04:10,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 20:04:10,490 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318650490,5,FailOnTimeoutGroup] 2023-02-13 20:04:10,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318650490,5,FailOnTimeoutGroup] 2023-02-13 20:04:10,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 20:04:10,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,498 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:04:10,499 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 20:04:10,499 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227 2023-02-13 20:04:10,510 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:10,511 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:04:10,512 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/info 2023-02-13 20:04:10,512 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:04:10,512 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:10,512 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:04:10,513 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:04:10,514 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:04:10,514 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:10,514 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:04:10,515 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/table 2023-02-13 20:04:10,515 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:04:10,515 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:10,516 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740 2023-02-13 20:04:10,516 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740 2023-02-13 20:04:10,517 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:04:10,518 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:04:10,520 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:04:10,521 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65103590, jitterRate=-0.029880911111831665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:04:10,521 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676318650510Initializing all the Stores at 1676318650510Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318650510Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318650510Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318650510Cleaning up temporary data from old regions at 1676318650517 (+7 ms)Cleaning up detritus from prior splits at 1676318650517Region opened successfully at 1676318650521 (+4 ms) 2023-02-13 20:04:10,521 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:04:10,521 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:04:10,521 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:04:10,521 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:04:10,521 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:04:10,521 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:04:10,521 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318650521Disabling compacts and flushes for region at 1676318650521Disabling writes for close at 1676318650521Writing region close event to WAL at 1676318650521Closed at 1676318650521 2023-02-13 20:04:10,522 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 20:04:10,522 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 20:04:10,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 20:04:10,523 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 20:04:10,527 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 20:04:10,549 INFO [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(952): ClusterId : 03c1c63e-5ec9-4e1e-a8c9-27ad20aa4736 2023-02-13 20:04:10,549 INFO [RS:0;jenkins-hbase4:41699] regionserver.HRegionServer(952): ClusterId : 03c1c63e-5ec9-4e1e-a8c9-27ad20aa4736 2023-02-13 20:04:10,549 DEBUG [RS:1;jenkins-hbase4:38529] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:04:10,550 DEBUG [RS:0;jenkins-hbase4:41699] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 20:04:10,552 DEBUG [RS:1;jenkins-hbase4:38529] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:04:10,552 DEBUG [RS:1;jenkins-hbase4:38529] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:04:10,552 DEBUG [RS:0;jenkins-hbase4:41699] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 20:04:10,552 DEBUG [RS:0;jenkins-hbase4:41699] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 20:04:10,554 DEBUG [RS:1;jenkins-hbase4:38529] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:04:10,556 DEBUG [RS:0;jenkins-hbase4:41699] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 20:04:10,556 DEBUG [RS:1;jenkins-hbase4:38529] zookeeper.ReadOnlyZKClient(139): Connect 0x604a0993 to 127.0.0.1:61635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:10,556 DEBUG [RS:0;jenkins-hbase4:41699] zookeeper.ReadOnlyZKClient(139): Connect 0x1b415335 to 127.0.0.1:61635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:10,560 DEBUG [RS:1;jenkins-hbase4:38529] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e8dfbea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:10,560 DEBUG [RS:0;jenkins-hbase4:41699] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1586ae2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:10,560 DEBUG [RS:1;jenkins-hbase4:38529] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ab262e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:04:10,560 DEBUG [RS:0;jenkins-hbase4:41699] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11b93845, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:04:10,568 DEBUG [RS:1;jenkins-hbase4:38529] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38529 2023-02-13 20:04:10,568 DEBUG [RS:0;jenkins-hbase4:41699] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41699 2023-02-13 20:04:10,568 INFO [RS:1;jenkins-hbase4:38529] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:04:10,568 INFO [RS:1;jenkins-hbase4:38529] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:04:10,568 INFO [RS:0;jenkins-hbase4:41699] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 20:04:10,569 INFO [RS:0;jenkins-hbase4:41699] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 20:04:10,568 DEBUG [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:04:10,569 DEBUG [RS:0;jenkins-hbase4:41699] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 20:04:10,569 INFO [RS:0;jenkins-hbase4:41699] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33867,1676318650263 with isa=jenkins-hbase4.apache.org/172.31.14.131:41699, startcode=1676318650308 2023-02-13 20:04:10,569 INFO [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33867,1676318650263 with isa=jenkins-hbase4.apache.org/172.31.14.131:38529, startcode=1676318650334 2023-02-13 20:04:10,569 DEBUG [RS:0;jenkins-hbase4:41699] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:04:10,569 DEBUG [RS:1;jenkins-hbase4:38529] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 20:04:10,571 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37343, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:04:10,571 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46845, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 20:04:10,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33867] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:10,573 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:10,574 DEBUG [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227 2023-02-13 20:04:10,574 DEBUG [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34861 2023-02-13 20:04:10,574 DEBUG [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:04:10,574 DEBUG [RS:0;jenkins-hbase4:41699] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227 2023-02-13 20:04:10,574 DEBUG [RS:0;jenkins-hbase4:41699] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34861 2023-02-13 20:04:10,574 DEBUG [RS:0;jenkins-hbase4:41699] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 20:04:10,580 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:10,581 DEBUG [RS:1;jenkins-hbase4:38529] zookeeper.ZKUtil(162): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:10,581 DEBUG [RS:0;jenkins-hbase4:41699] zookeeper.ZKUtil(162): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:10,581 WARN [RS:1;jenkins-hbase4:38529] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:04:10,581 WARN [RS:0;jenkins-hbase4:41699] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 20:04:10,581 INFO [RS:1;jenkins-hbase4:38529] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:04:10,581 INFO [RS:0;jenkins-hbase4:41699] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:04:10,581 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41699,1676318650308] 2023-02-13 20:04:10,581 DEBUG [RS:0;jenkins-hbase4:41699] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/WALs/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:10,581 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38529,1676318650334] 2023-02-13 20:04:10,581 DEBUG [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/WALs/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:10,588 DEBUG [RS:1;jenkins-hbase4:38529] zookeeper.ZKUtil(162): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:10,588 DEBUG [RS:0;jenkins-hbase4:41699] zookeeper.ZKUtil(162): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:10,588 DEBUG [RS:1;jenkins-hbase4:38529] zookeeper.ZKUtil(162): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:10,588 DEBUG [RS:0;jenkins-hbase4:41699] zookeeper.ZKUtil(162): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:10,589 DEBUG [RS:1;jenkins-hbase4:38529] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:04:10,589 DEBUG [RS:0;jenkins-hbase4:41699] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 20:04:10,589 INFO [RS:1;jenkins-hbase4:38529] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:04:10,590 INFO [RS:0;jenkins-hbase4:41699] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 20:04:10,592 INFO [RS:1;jenkins-hbase4:38529] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:04:10,592 INFO [RS:0;jenkins-hbase4:41699] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 20:04:10,593 INFO [RS:1;jenkins-hbase4:38529] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:04:10,593 INFO [RS:1;jenkins-hbase4:38529] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,593 INFO [RS:0;jenkins-hbase4:41699] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 20:04:10,594 INFO [RS:0;jenkins-hbase4:41699] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,594 INFO [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:04:10,596 INFO [RS:0;jenkins-hbase4:41699] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 20:04:10,598 INFO [RS:1;jenkins-hbase4:38529] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,598 INFO [RS:0;jenkins-hbase4:41699] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,599 DEBUG [RS:1;jenkins-hbase4:38529] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,600 DEBUG [RS:1;jenkins-hbase4:38529] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,600 DEBUG [RS:0;jenkins-hbase4:41699] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,600 DEBUG [RS:1;jenkins-hbase4:38529] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:0;jenkins-hbase4:41699] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:1;jenkins-hbase4:38529] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:0;jenkins-hbase4:41699] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:1;jenkins-hbase4:38529] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:0;jenkins-hbase4:41699] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:1;jenkins-hbase4:38529] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:04:10,601 DEBUG [RS:0;jenkins-hbase4:41699] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:1;jenkins-hbase4:38529] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:0;jenkins-hbase4:41699] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 20:04:10,601 DEBUG [RS:1;jenkins-hbase4:38529] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:0;jenkins-hbase4:41699] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:1;jenkins-hbase4:38529] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:0;jenkins-hbase4:41699] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:1;jenkins-hbase4:38529] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:0;jenkins-hbase4:41699] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,601 DEBUG [RS:0;jenkins-hbase4:41699] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 20:04:10,602 INFO [RS:1;jenkins-hbase4:38529] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,602 INFO [RS:1;jenkins-hbase4:38529] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,602 INFO [RS:1;jenkins-hbase4:38529] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,603 INFO [RS:0;jenkins-hbase4:41699] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,603 INFO [RS:0;jenkins-hbase4:41699] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,603 INFO [RS:0;jenkins-hbase4:41699] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,615 INFO [RS:0;jenkins-hbase4:41699] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:04:10,615 INFO [RS:1;jenkins-hbase4:38529] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 20:04:10,615 INFO [RS:0;jenkins-hbase4:41699] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41699,1676318650308-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,615 INFO [RS:1;jenkins-hbase4:38529] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38529,1676318650334-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,626 INFO [RS:0;jenkins-hbase4:41699] regionserver.Replication(203): jenkins-hbase4.apache.org,41699,1676318650308 started 2023-02-13 20:04:10,626 INFO [RS:0;jenkins-hbase4:41699] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41699,1676318650308, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41699, sessionid=0x1004f4899480001 2023-02-13 20:04:10,626 INFO [RS:1;jenkins-hbase4:38529] regionserver.Replication(203): jenkins-hbase4.apache.org,38529,1676318650334 started 2023-02-13 20:04:10,626 DEBUG [RS:0;jenkins-hbase4:41699] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:04:10,627 DEBUG [RS:0;jenkins-hbase4:41699] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:10,627 DEBUG [RS:0;jenkins-hbase4:41699] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41699,1676318650308' 2023-02-13 20:04:10,627 DEBUG [RS:0;jenkins-hbase4:41699] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:10,627 INFO [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38529,1676318650334, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38529, sessionid=0x1004f4899480002 2023-02-13 20:04:10,627 DEBUG [RS:1;jenkins-hbase4:38529] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 20:04:10,627 DEBUG [RS:1;jenkins-hbase4:38529] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:10,627 DEBUG [RS:1;jenkins-hbase4:38529] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38529,1676318650334' 2023-02-13 20:04:10,627 DEBUG [RS:1;jenkins-hbase4:38529] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:10,627 DEBUG [RS:0;jenkins-hbase4:41699] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:10,627 DEBUG [RS:1;jenkins-hbase4:38529] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:10,627 DEBUG [RS:0;jenkins-hbase4:41699] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:04:10,627 DEBUG [RS:0;jenkins-hbase4:41699] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:04:10,627 DEBUG [RS:0;jenkins-hbase4:41699] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:10,627 DEBUG [RS:0;jenkins-hbase4:41699] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41699,1676318650308' 2023-02-13 20:04:10,627 DEBUG [RS:0;jenkins-hbase4:41699] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:10,627 DEBUG [RS:1;jenkins-hbase4:38529] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 20:04:10,627 DEBUG [RS:1;jenkins-hbase4:38529] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 20:04:10,628 DEBUG [RS:1;jenkins-hbase4:38529] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:10,628 DEBUG [RS:1;jenkins-hbase4:38529] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38529,1676318650334' 2023-02-13 20:04:10,628 DEBUG [RS:1;jenkins-hbase4:38529] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:10,628 DEBUG [RS:0;jenkins-hbase4:41699] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:10,628 DEBUG [RS:1;jenkins-hbase4:38529] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:10,628 DEBUG [RS:0;jenkins-hbase4:41699] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:04:10,628 INFO [RS:0;jenkins-hbase4:41699] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:04:10,628 INFO [RS:0;jenkins-hbase4:41699] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:04:10,628 DEBUG [RS:1;jenkins-hbase4:38529] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 20:04:10,628 INFO [RS:1;jenkins-hbase4:38529] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 20:04:10,628 INFO [RS:1;jenkins-hbase4:38529] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 20:04:10,677 DEBUG [jenkins-hbase4:33867] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 20:04:10,677 DEBUG [jenkins-hbase4:33867] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:04:10,679 DEBUG [jenkins-hbase4:33867] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:04:10,679 DEBUG [jenkins-hbase4:33867] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:04:10,679 DEBUG [jenkins-hbase4:33867] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:04:10,679 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38529,1676318650334, state=OPENING 2023-02-13 20:04:10,681 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 20:04:10,682 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:10,682 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:04:10,682 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38529,1676318650334}] 2023-02-13 20:04:10,837 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:10,837 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 20:04:10,839 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38342, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 20:04:10,842 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 20:04:10,843 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 20:04:10,844 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38529%2C1676318650334.meta, suffix=.meta, logDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/WALs/jenkins-hbase4.apache.org,38529,1676318650334, archiveDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/oldWALs, maxLogs=32 2023-02-13 20:04:10,858 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38345,DS-5896ff6c-cd97-40f2-bcc2-95369af0b85c,DISK] 2023-02-13 20:04:10,859 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42183,DS-4195a749-6f54-46eb-a526-75c02377018c,DISK] 2023-02-13 20:04:10,860 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/WALs/jenkins-hbase4.apache.org,38529,1676318650334/jenkins-hbase4.apache.org%2C38529%2C1676318650334.meta.1676318650844.meta 2023-02-13 20:04:10,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42183,DS-4195a749-6f54-46eb-a526-75c02377018c,DISK], DatanodeInfoWithStorage[127.0.0.1:38345,DS-5896ff6c-cd97-40f2-bcc2-95369af0b85c,DISK]] 2023-02-13 20:04:10,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:04:10,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 20:04:10,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 20:04:10,861 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 20:04:10,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 20:04:10,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:10,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 20:04:10,861 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 20:04:10,862 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 20:04:10,863 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/info 2023-02-13 20:04:10,863 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/info 2023-02-13 20:04:10,863 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 20:04:10,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:10,864 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 20:04:10,865 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:04:10,865 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/rep_barrier 2023-02-13 20:04:10,865 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 20:04:10,865 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:10,865 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 20:04:10,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/table 2023-02-13 20:04:10,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/table 2023-02-13 20:04:10,866 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 20:04:10,866 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:10,867 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740 2023-02-13 20:04:10,868 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740 2023-02-13 20:04:10,869 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 20:04:10,870 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 20:04:10,871 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69081436, jitterRate=0.02939361333847046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 20:04:10,871 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676318650862Writing region info on filesystem at 1676318650862Initializing all the Stores at 1676318650862Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318650862Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318650862Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318650862Cleaning up temporary data from old regions at 1676318650868 (+6 ms)Cleaning up detritus from prior splits at 1676318650869 (+1 ms)Running coprocessor post-open hooks at 1676318650871 (+2 ms)Region opened successfully at 1676318650871 2023-02-13 20:04:10,871 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676318650837 2023-02-13 20:04:10,875 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 20:04:10,877 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 20:04:10,877 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38529,1676318650334, state=OPEN 2023-02-13 20:04:10,878 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 20:04:10,879 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 20:04:10,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 20:04:10,880 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38529,1676318650334 in 197 msec 2023-02-13 20:04:10,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 20:04:10,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 358 msec 2023-02-13 20:04:10,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 403 msec 2023-02-13 20:04:10,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676318650350, completionTime=-1 2023-02-13 20:04:10,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 20:04:10,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 20:04:10,888 DEBUG [hconnection-0x17e7ceeb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:04:10,889 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38344, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:04:10,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 20:04:10,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676318710890 2023-02-13 20:04:10,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676318770890 2023-02-13 20:04:10,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-13 20:04:10,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33867,1676318650263-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33867,1676318650263-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33867,1676318650263-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33867, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 20:04:10,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 20:04:10,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 20:04:10,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 20:04:10,899 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 20:04:10,899 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:04:10,900 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:04:10,901 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/hbase/namespace/b056cf84f28f4ae9b2a54504b439e210 2023-02-13 20:04:10,901 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/hbase/namespace/b056cf84f28f4ae9b2a54504b439e210 empty. 2023-02-13 20:04:10,902 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/hbase/namespace/b056cf84f28f4ae9b2a54504b439e210 2023-02-13 20:04:10,902 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 20:04:10,910 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 20:04:10,911 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => b056cf84f28f4ae9b2a54504b439e210, NAME => 'hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp 2023-02-13 20:04:10,918 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:10,918 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing b056cf84f28f4ae9b2a54504b439e210, disabling compactions & flushes 2023-02-13 20:04:10,918 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. 2023-02-13 20:04:10,918 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. 2023-02-13 20:04:10,918 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. after waiting 0 ms 2023-02-13 20:04:10,918 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. 2023-02-13 20:04:10,918 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. 2023-02-13 20:04:10,918 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for b056cf84f28f4ae9b2a54504b439e210: Waiting for close lock at 1676318650918Disabling compacts and flushes for region at 1676318650918Disabling writes for close at 1676318650918Writing region close event to WAL at 1676318650918Closed at 1676318650918 2023-02-13 20:04:10,919 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:04:10,920 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318650920"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318650920"}]},"ts":"1676318650920"} 2023-02-13 20:04:10,921 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 20:04:10,922 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:04:10,922 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318650922"}]},"ts":"1676318650922"} 2023-02-13 20:04:10,923 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 20:04:10,926 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:04:10,926 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:04:10,926 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:04:10,926 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:04:10,927 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b056cf84f28f4ae9b2a54504b439e210, ASSIGN}] 2023-02-13 20:04:10,930 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b056cf84f28f4ae9b2a54504b439e210, ASSIGN 2023-02-13 20:04:10,931 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b056cf84f28f4ae9b2a54504b439e210, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38529,1676318650334; forceNewPlan=false, retain=false 2023-02-13 20:04:11,081 INFO [jenkins-hbase4:33867] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 20:04:11,082 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b056cf84f28f4ae9b2a54504b439e210, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:11,082 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318651081"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318651081"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318651081"}]},"ts":"1676318651081"} 2023-02-13 20:04:11,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b056cf84f28f4ae9b2a54504b439e210, server=jenkins-hbase4.apache.org,38529,1676318650334}] 2023-02-13 20:04:11,238 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. 2023-02-13 20:04:11,239 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38529%2C1676318650334, suffix=, logDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/WALs/jenkins-hbase4.apache.org,38529,1676318650334, archiveDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/oldWALs, maxLogs=32 2023-02-13 20:04:11,252 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38345,DS-5896ff6c-cd97-40f2-bcc2-95369af0b85c,DISK] 2023-02-13 20:04:11,252 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42183,DS-4195a749-6f54-46eb-a526-75c02377018c,DISK] 2023-02-13 20:04:11,253 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/WALs/jenkins-hbase4.apache.org,38529,1676318650334/jenkins-hbase4.apache.org%2C38529%2C1676318650334.1676318651239 2023-02-13 20:04:11,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38345,DS-5896ff6c-cd97-40f2-bcc2-95369af0b85c,DISK], DatanodeInfoWithStorage[127.0.0.1:42183,DS-4195a749-6f54-46eb-a526-75c02377018c,DISK]] 2023-02-13 20:04:11,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b056cf84f28f4ae9b2a54504b439e210, NAME => 'hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:04:11,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b056cf84f28f4ae9b2a54504b439e210 2023-02-13 20:04:11,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:11,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b056cf84f28f4ae9b2a54504b439e210 2023-02-13 20:04:11,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b056cf84f28f4ae9b2a54504b439e210 2023-02-13 20:04:11,255 INFO [StoreOpener-b056cf84f28f4ae9b2a54504b439e210-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b056cf84f28f4ae9b2a54504b439e210 2023-02-13 20:04:11,256 DEBUG [StoreOpener-b056cf84f28f4ae9b2a54504b439e210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/namespace/b056cf84f28f4ae9b2a54504b439e210/info 2023-02-13 20:04:11,256 DEBUG [StoreOpener-b056cf84f28f4ae9b2a54504b439e210-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/namespace/b056cf84f28f4ae9b2a54504b439e210/info 2023-02-13 20:04:11,256 INFO [StoreOpener-b056cf84f28f4ae9b2a54504b439e210-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b056cf84f28f4ae9b2a54504b439e210 columnFamilyName info 2023-02-13 20:04:11,257 INFO [StoreOpener-b056cf84f28f4ae9b2a54504b439e210-1] regionserver.HStore(310): Store=b056cf84f28f4ae9b2a54504b439e210/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:11,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/namespace/b056cf84f28f4ae9b2a54504b439e210 2023-02-13 20:04:11,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/namespace/b056cf84f28f4ae9b2a54504b439e210 2023-02-13 20:04:11,259 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b056cf84f28f4ae9b2a54504b439e210 2023-02-13 20:04:11,261 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/namespace/b056cf84f28f4ae9b2a54504b439e210/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:04:11,261 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b056cf84f28f4ae9b2a54504b439e210; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70343616, jitterRate=0.048201560974121094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 20:04:11,261 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b056cf84f28f4ae9b2a54504b439e210: Running coprocessor pre-open hook at 1676318651254Writing region info on filesystem at 1676318651254Initializing all the Stores at 1676318651255 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676318651255Cleaning up temporary data from old regions at 1676318651258 (+3 ms)Cleaning up detritus from prior splits at 1676318651258Running coprocessor post-open hooks at 1676318651261 (+3 ms)Region opened successfully at 1676318651261 2023-02-13 20:04:11,262 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210., pid=6, masterSystemTime=1676318651235 2023-02-13 20:04:11,263 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. 2023-02-13 20:04:11,264 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. 2023-02-13 20:04:11,264 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b056cf84f28f4ae9b2a54504b439e210, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:11,264 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676318651264"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318651264"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318651264"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318651264"}]},"ts":"1676318651264"} 2023-02-13 20:04:11,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 20:04:11,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b056cf84f28f4ae9b2a54504b439e210, server=jenkins-hbase4.apache.org,38529,1676318650334 in 182 msec 2023-02-13 20:04:11,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 20:04:11,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b056cf84f28f4ae9b2a54504b439e210, ASSIGN in 340 msec 2023-02-13 20:04:11,268 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:04:11,269 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318651269"}]},"ts":"1676318651269"} 2023-02-13 20:04:11,270 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 20:04:11,271 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:04:11,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 375 msec 2023-02-13 20:04:11,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 20:04:11,301 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:04:11,301 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:11,304 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 20:04:11,310 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:04:11,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-13 20:04:11,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 20:04:11,320 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 20:04:11,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 7 msec 2023-02-13 20:04:11,328 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 20:04:11,331 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 20:04:11,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.974sec 2023-02-13 20:04:11,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 20:04:11,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 20:04:11,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 20:04:11,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33867,1676318650263-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 20:04:11,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33867,1676318650263-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 20:04:11,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 20:04:11,350 DEBUG [Listener at localhost/33573] zookeeper.ReadOnlyZKClient(139): Connect 0x58aaaced to 127.0.0.1:61635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:11,352 DEBUG [Listener at localhost/33573] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@628e6686, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:11,354 DEBUG [hconnection-0x6b9f220c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:04:11,355 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38358, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:04:11,356 INFO [Listener at localhost/33573] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33867,1676318650263 2023-02-13 20:04:11,356 DEBUG [Listener at localhost/33573] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 20:04:11,358 DEBUG [Listener at localhost/33573] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 20:04:11,360 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58222, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 20:04:11,360 INFO [Listener at localhost/33573] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 20:04:11,360 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 20:04:11,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 20:04:11,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:58222 deadline: 1676318711360, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 20:04:11,361 INFO [Listener at localhost/33573] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 20:04:11,363 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 20:04:11,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 20:04:11,365 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 20:04:11,365 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 20:04:11,365 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 20:04:11,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:04:11,367 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:11,367 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75 empty. 2023-02-13 20:04:11,367 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:11,367 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 20:04:11,376 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 20:04:11,377 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e450b2adea4f519baa983c406c6b0f75, NAME => 'testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp 2023-02-13 20:04:11,386 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:11,386 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e450b2adea4f519baa983c406c6b0f75, disabling compactions & flushes 2023-02-13 20:04:11,386 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:11,386 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:11,386 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. after waiting 0 ms 2023-02-13 20:04:11,386 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:11,386 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:11,386 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e450b2adea4f519baa983c406c6b0f75: Waiting for close lock at 1676318651386Disabling compacts and flushes for region at 1676318651386Disabling writes for close at 1676318651386Writing region close event to WAL at 1676318651386Closed at 1676318651386 2023-02-13 20:04:11,388 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 20:04:11,388 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676318651388"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318651388"}]},"ts":"1676318651388"} 2023-02-13 20:04:11,390 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 20:04:11,390 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 20:04:11,390 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318651390"}]},"ts":"1676318651390"} 2023-02-13 20:04:11,391 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 20:04:11,394 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 20:04:11,395 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 20:04:11,395 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 20:04:11,395 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 20:04:11,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e450b2adea4f519baa983c406c6b0f75, ASSIGN}] 2023-02-13 20:04:11,396 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e450b2adea4f519baa983c406c6b0f75, ASSIGN 2023-02-13 20:04:11,396 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e450b2adea4f519baa983c406c6b0f75, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38529,1676318650334; forceNewPlan=false, retain=false 2023-02-13 20:04:11,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:04:11,547 INFO [jenkins-hbase4:33867] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 20:04:11,547 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e450b2adea4f519baa983c406c6b0f75, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:11,547 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676318651547"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318651547"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318651547"}]},"ts":"1676318651547"} 2023-02-13 20:04:11,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure e450b2adea4f519baa983c406c6b0f75, server=jenkins-hbase4.apache.org,38529,1676318650334}] 2023-02-13 20:04:11,630 INFO [RS:0;jenkins-hbase4:41699] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41699%2C1676318650308, suffix=, logDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/WALs/jenkins-hbase4.apache.org,41699,1676318650308, archiveDir=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/oldWALs, maxLogs=32 2023-02-13 20:04:11,644 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42183,DS-4195a749-6f54-46eb-a526-75c02377018c,DISK] 2023-02-13 20:04:11,644 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38345,DS-5896ff6c-cd97-40f2-bcc2-95369af0b85c,DISK] 2023-02-13 20:04:11,646 INFO [RS:0;jenkins-hbase4:41699] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/WALs/jenkins-hbase4.apache.org,41699,1676318650308/jenkins-hbase4.apache.org%2C41699%2C1676318650308.1676318651630 2023-02-13 20:04:11,646 DEBUG [RS:0;jenkins-hbase4:41699] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42183,DS-4195a749-6f54-46eb-a526-75c02377018c,DISK], DatanodeInfoWithStorage[127.0.0.1:38345,DS-5896ff6c-cd97-40f2-bcc2-95369af0b85c,DISK]] 2023-02-13 20:04:11,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:04:11,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:11,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e450b2adea4f519baa983c406c6b0f75, NAME => 'testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.', STARTKEY => '', ENDKEY => ''} 2023-02-13 20:04:11,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:11,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:11,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:11,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:11,704 INFO [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:11,705 DEBUG [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1 2023-02-13 20:04:11,705 DEBUG [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1 2023-02-13 20:04:11,706 INFO [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e450b2adea4f519baa983c406c6b0f75 columnFamilyName f1 2023-02-13 20:04:11,706 INFO [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] regionserver.HStore(310): Store=e450b2adea4f519baa983c406c6b0f75/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:11,706 INFO [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:11,707 DEBUG [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2 2023-02-13 20:04:11,707 DEBUG [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2 2023-02-13 20:04:11,707 INFO [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e450b2adea4f519baa983c406c6b0f75 columnFamilyName f2 2023-02-13 20:04:11,708 INFO [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] regionserver.HStore(310): Store=e450b2adea4f519baa983c406c6b0f75/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:11,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:11,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:11,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:04:11,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:11,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 20:04:11,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e450b2adea4f519baa983c406c6b0f75; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71340471, jitterRate=0.0630558580160141}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:04:11,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e450b2adea4f519baa983c406c6b0f75: Running coprocessor pre-open hook at 1676318651703Writing region info on filesystem at 1676318651703Initializing all the Stores at 1676318651704 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318651704Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318651704Cleaning up temporary data from old regions at 1676318651709 (+5 ms)Cleaning up detritus from prior splits at 1676318651709Running coprocessor post-open hooks at 1676318651713 (+4 ms)Region opened successfully at 1676318651713 2023-02-13 20:04:11,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75., pid=12, masterSystemTime=1676318651700 2023-02-13 20:04:11,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:11,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:11,715 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e450b2adea4f519baa983c406c6b0f75, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:11,715 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676318651715"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676318651715"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676318651715"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676318651715"}]},"ts":"1676318651715"} 2023-02-13 20:04:11,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 20:04:11,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure e450b2adea4f519baa983c406c6b0f75, server=jenkins-hbase4.apache.org,38529,1676318650334 in 167 msec 2023-02-13 20:04:11,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 20:04:11,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e450b2adea4f519baa983c406c6b0f75, ASSIGN in 322 msec 2023-02-13 20:04:11,719 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 20:04:11,719 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318651719"}]},"ts":"1676318651719"} 2023-02-13 20:04:11,720 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 20:04:11,723 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 20:04:11,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 360 msec 2023-02-13 20:04:11,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 20:04:11,970 INFO [Listener at localhost/33573] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 20:04:11,970 DEBUG [Listener at localhost/33573] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 20:04:11,971 INFO [Listener at localhost/33573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:04:11,972 INFO [Listener at localhost/33573] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 20:04:11,973 INFO [Listener at localhost/33573] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 20:04:11,973 INFO [Listener at localhost/33573] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 20:04:11,973 INFO [Listener at localhost/33573] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 20:04:12,001 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38529] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:12,149 INFO [Listener at localhost/33573] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 20:04:12,149 INFO [Listener at localhost/33573] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 20:04:12,150 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 20:04:12,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676318652150 (current time:1676318652150). 2023-02-13 20:04:12,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 20:04:12,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] zookeeper.ReadOnlyZKClient(139): Connect 0x40aa0328 to 127.0.0.1:61635 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 20:04:12,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c7352c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 20:04:12,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 20:04:12,156 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38366, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 20:04:12,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40aa0328 to 127.0.0.1:61635 2023-02-13 20:04:12,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:12,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 20:04:12,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 20:04:12,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 20:04:12,161 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 20:04:12,161 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676319252161 2023-02-13 20:04:12,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 20:04:12,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 20:04:12,163 DEBUG [Listener at localhost/33573] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 20:04:12,163 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 20:04:12,163 DEBUG [Listener at localhost/33573] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 20:04:12,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 20:04:12,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-13 20:04:12,165 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 20:04:12,165 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676319252165 2023-02-13 20:04:12,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-13 20:04:12,173 INFO [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-13 20:04:12,173 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:04:12,174 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-13 20:04:12,174 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 20:04:12,175 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,175 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 20:04:12,176 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:04:12,176 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:04:12,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:12,176 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:04:12,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:04:12,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:12,176 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,176 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:04:12,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 20:04:12,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 20:04:12,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-13 20:04:12,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 20:04:12,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-13 20:04:12,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 20:04:12,177 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-13 20:04:12,177 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-13 20:04:12,177 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-13 20:04:12,177 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-13 20:04:12,177 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-13 20:04:12,177 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:04:12,177 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-13 20:04:12,178 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 20:04:12,178 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-13 20:04:12,178 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 20:04:12,178 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38529,1676318650334' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-13 20:04:12,180 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 20:04:12,180 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-13 20:04:12,180 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41699,1676318650308' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-13 20:04:12,183 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 20:04:12,183 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,183 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 20:04:12,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:12,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:04:12,183 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 20:04:12,183 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:04:12,183 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 20:04:12,183 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:04:12,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:12,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:12,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 20:04:12,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:12,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38529,1676318650334' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-13 20:04:12,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a766a26[Count = 0] remaining members to acquire global barrier 2023-02-13 20:04:12,185 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 20:04:12,185 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 20:04:12,186 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 20:04:12,186 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 20:04:12,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 20:04:12,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 20:04:12,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 20:04:12,186 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 20:04:12,186 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,186 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:04:12,186 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-13 20:04:12,186 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,41699,1676318650308' in zk 2023-02-13 20:04:12,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 20:04:12,186 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 20:04:12,186 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 20:04:12,186 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 20:04:12,186 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:12,186 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. started... 2023-02-13 20:04:12,186 INFO [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e450b2adea4f519baa983c406c6b0f75 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 20:04:12,187 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-13 20:04:12,187 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:12,187 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-13 20:04:12,200 INFO [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/.tmp/f1/82342adfabd042ebb97e259c5ab26c3e 2023-02-13 20:04:12,213 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 20:04:12,218 INFO [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/.tmp/f2/53f22d8b83d24fb5bd4afc1482892fbd 2023-02-13 20:04:12,225 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/.tmp/f1/82342adfabd042ebb97e259c5ab26c3e as hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1/82342adfabd042ebb97e259c5ab26c3e 2023-02-13 20:04:12,229 INFO [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1/82342adfabd042ebb97e259c5ab26c3e, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 20:04:12,230 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/.tmp/f2/53f22d8b83d24fb5bd4afc1482892fbd as hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2/53f22d8b83d24fb5bd4afc1482892fbd 2023-02-13 20:04:12,240 INFO [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2/53f22d8b83d24fb5bd4afc1482892fbd, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 20:04:12,241 INFO [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for e450b2adea4f519baa983c406c6b0f75 in 55ms, sequenceid=5, compaction requested=false 2023-02-13 20:04:12,241 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e450b2adea4f519baa983c406c6b0f75: 2023-02-13 20:04:12,242 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-13 20:04:12,242 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 20:04:12,242 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1/82342adfabd042ebb97e259c5ab26c3e] hfiles 2023-02-13 20:04:12,242 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1/82342adfabd042ebb97e259c5ab26c3e for snapshot=testWithMapReduceSingleRegion 2023-02-13 20:04:12,242 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2/53f22d8b83d24fb5bd4afc1482892fbd] hfiles 2023-02-13 20:04:12,242 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2/53f22d8b83d24fb5bd4afc1482892fbd for snapshot=testWithMapReduceSingleRegion 2023-02-13 20:04:12,251 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. completed. 2023-02-13 20:04:12,252 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:12,252 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 20:04:12,252 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 20:04:12,252 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,252 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-13 20:04:12,252 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38529,1676318650334' in zk 2023-02-13 20:04:12,257 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-13 20:04:12,257 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,257 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:12,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:12,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:04:12,257 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-13 20:04:12,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:12,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:12,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 20:04:12,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:12,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 20:04:12,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,38529,1676318650334': 2023-02-13 20:04:12,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38529,1676318650334' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 20:04:12,260 INFO [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-13 20:04:12,261 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:04:12,261 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:04:12,261 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-13 20:04:12,261 INFO [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 20:04:12,263 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,263 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,263 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 20:04:12,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,263 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:04:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,263 DEBUG [Listener at localhost/33573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:04:12,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:12,263 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:04:12,264 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:04:12,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:12,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:04:12,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:12,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 20:04:12,264 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:12,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 20:04:12,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 20:04:12,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,265 DEBUG [Listener at localhost/33573] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 20:04:12,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 20:04:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,266 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,266 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:12,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 20:04:12,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,275 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:04:12,275 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 20:04:12,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:04:12,275 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:12,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 20:04:12,275 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:12,275 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:04:12,275 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 20:04:12,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion because node does not exist (not an error) 2023-02-13 20:04:12,275 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-13 20:04:12,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 20:04:12,275 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 20:04:12,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:04:12,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-13 20:04:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:12,276 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 20:04:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 20:04:12,276 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 20:04:12,276 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,276 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 20:04:12,276 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,276 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 20:04:12,276 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 20:04:12,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 20:04:12,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-13 20:04:12,344 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-13 20:04:12,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 20:04:12,346 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 20:04:12,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676318652162Consolidate snapshot: testWithMapReduceSingleRegion at 1676318652276 (+114 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676318652276Writing data manifest for testWithMapReduceSingleRegion at 1676318652279 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676318652301 (+22 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676318652344 (+43 ms) 2023-02-13 20:04:12,351 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 20:04:12,354 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 188 msec 2023-02-13 20:04:12,465 DEBUG [Listener at localhost/33573] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 20:04:12,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 20:04:12,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 20:04:12,467 INFO [Listener at localhost/33573] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 20:04:12,470 INFO [Listener at localhost/33573] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 20:04:12,475 INFO [Listener at localhost/33573] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 20:04:12,501 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38529] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:12,583 INFO [Listener at localhost/33573] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 20:04:12,588 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 20:04:12,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 20:04:12,590 INFO [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 20:04:12,590 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:04:12,590 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 20:04:12,590 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 20:04:12,590 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,591 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:04:12,592 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:04:12,592 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:04:12,592 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:04:12,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:12,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:04:12,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:12,592 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,592 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 20:04:12,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:04:12,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:04:12,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:04:12,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:04:12,593 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 20:04:12,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 20:04:12,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:04:12,593 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 20:04:12,593 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 20:04:12,593 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 20:04:12,593 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 20:04:12,593 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:04:12,593 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 20:04:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 20:04:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 20:04:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 20:04:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 20:04:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41699,1676318650308' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 20:04:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 20:04:12,594 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 20:04:12,594 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:12,594 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. started... 2023-02-13 20:04:12,594 INFO [rs(jenkins-hbase4.apache.org,38529,1676318650334)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e450b2adea4f519baa983c406c6b0f75 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 20:04:12,596 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:04:12,596 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:04:12,596 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:04:12,615 INFO [rs(jenkins-hbase4.apache.org,38529,1676318650334)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/.tmp/f1/a7802fce1b10452b947fec623e9f8058 2023-02-13 20:04:12,640 INFO [rs(jenkins-hbase4.apache.org,38529,1676318650334)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/.tmp/f2/154f9da3781e409697b586d42be7a14c 2023-02-13 20:04:12,645 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/.tmp/f1/a7802fce1b10452b947fec623e9f8058 as hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1/a7802fce1b10452b947fec623e9f8058 2023-02-13 20:04:12,649 INFO [rs(jenkins-hbase4.apache.org,38529,1676318650334)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1/a7802fce1b10452b947fec623e9f8058, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 20:04:12,650 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/.tmp/f2/154f9da3781e409697b586d42be7a14c as hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2/154f9da3781e409697b586d42be7a14c 2023-02-13 20:04:12,654 INFO [rs(jenkins-hbase4.apache.org,38529,1676318650334)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2/154f9da3781e409697b586d42be7a14c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 20:04:12,655 INFO [rs(jenkins-hbase4.apache.org,38529,1676318650334)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for e450b2adea4f519baa983c406c6b0f75 in 61ms, sequenceid=9, compaction requested=false 2023-02-13 20:04:12,655 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e450b2adea4f519baa983c406c6b0f75: 2023-02-13 20:04:12,655 DEBUG [rs(jenkins-hbase4.apache.org,38529,1676318650334)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:12,655 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 20:04:12,655 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 20:04:12,655 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,655 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 20:04:12,655 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38529,1676318650334' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 20:04:12,657 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,657 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:04:12,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:12,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:04:12,657 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:04:12,657 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 20:04:12,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:04:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:12,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38529,1676318650334' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 20:04:12,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e49f3b0[Count = 0] remaining members to acquire global barrier 2023-02-13 20:04:12,659 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 20:04:12,659 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:04:12,660 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:04:12,660 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:04:12,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:04:12,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:04:12,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:04:12,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:04:12,660 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 20:04:12,660 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 20:04:12,660 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 20:04:12,661 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38529,1676318650334' in zk 2023-02-13 20:04:12,660 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,661 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 20:04:12,660 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 20:04:12,661 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41699,1676318650308' in zk 2023-02-13 20:04:12,662 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,662 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 20:04:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:12,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:04:12,662 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:12,662 DEBUG [member: 'jenkins-hbase4.apache.org,38529,1676318650334' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 20:04:12,663 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 20:04:12,663 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:12,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:12,664 DEBUG [member: 'jenkins-hbase4.apache.org,41699,1676318650308' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 20:04:12,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:12,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:04:12,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:12,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:04:12,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38529,1676318650334': 2023-02-13 20:04:12,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38529,1676318650334' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 20:04:12,666 INFO [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 20:04:12,666 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 20:04:12,666 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 20:04:12,666 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 20:04:12,666 INFO [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 20:04:12,668 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,668 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,668 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,668 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:04:12,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 20:04:12,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 20:04:12,668 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:04:12,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:04:12,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 20:04:12,668 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:04:12,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:12,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:12,669 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:04:12,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 20:04:12,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:04:12,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,670 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,670 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 20:04:12,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 20:04:12,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,673 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,673 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:04:12,673 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:04:12,673 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,673 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 20:04:12,673 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 20:04:12,673 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 20:04:12,673 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 20:04:12,673 DEBUG [(jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 20:04:12,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:04:12,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:12,673 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:04:12,673 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:12,673 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 20:04:12,673 DEBUG [Listener at localhost/33573] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 20:04:12,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 20:04:12,673 DEBUG [Listener at localhost/33573] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 20:04:12,673 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:04:12,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 20:04:12,674 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:12,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:04:12,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:12,674 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 20:04:12,674 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 20:04:12,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 20:04:12,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 20:04:12,774 DEBUG [Listener at localhost/33573] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 20:04:12,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 20:04:12,874 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/hadoop-1960733805747429870.jar 2023-02-13 20:04:12,878 INFO [Listener at localhost/33573] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676318652150 type: FLUSH version: 2 ttl: 0 2023-02-13 20:04:12,878 DEBUG [Listener at localhost/33573] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34861/user/jenkins/test-data/570a6248-b114-07a1-0c6f-635e7ccb23ba/testWithMapReduceSingleRegion/4ad0f02a-942c-4664-a22a-c8a0832a8c65/data/default/testWithMapReduce 2023-02-13 20:04:12,879 INFO [Listener at localhost/33573] snapshot.RestoreSnapshotHelper(239): region to add: e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:12,879 INFO [Listener at localhost/33573] snapshot.RestoreSnapshotHelper(585): clone region=e450b2adea4f519baa983c406c6b0f75 as e450b2adea4f519baa983c406c6b0f75 in snapshot testWithMapReduceSingleRegion 2023-02-13 20:04:12,880 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e450b2adea4f519baa983c406c6b0f75, NAME => 'testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34861/user/jenkins/test-data/570a6248-b114-07a1-0c6f-635e7ccb23ba/testWithMapReduceSingleRegion/4ad0f02a-942c-4664-a22a-c8a0832a8c65 2023-02-13 20:04:12,888 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:12,889 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 82342adfabd042ebb97e259c5ab26c3e from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-13 20:04:12,890 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 53f22d8b83d24fb5bd4afc1482892fbd from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-13 20:04:12,892 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e450b2adea4f519baa983c406c6b0f75, disabling compactions & flushes 2023-02-13 20:04:12,892 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:12,892 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:12,892 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. after waiting 0 ms 2023-02-13 20:04:12,892 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:12,892 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:12,892 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e450b2adea4f519baa983c406c6b0f75: Waiting for close lock at 1676318652892Disabling compacts and flushes for region at 1676318652892Disabling writes for close at 1676318652892Writing region close event to WAL at 1676318652892Closed at 1676318652892 2023-02-13 20:04:12,893 INFO [Listener at localhost/33573] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676318652150 type: FLUSH version: 2 ttl: 0 2023-02-13 20:04:12,893 DEBUG [Listener at localhost/33573] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34861/user/jenkins/test-data/570a6248-b114-07a1-0c6f-635e7ccb23ba/testWithMapReduceSingleRegion/4ad0f02a-942c-4664-a22a-c8a0832a8c65 2023-02-13 20:04:12,893 DEBUG [Listener at localhost/33573] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34861/user/jenkins/test-data/570a6248-b114-07a1-0c6f-635e7ccb23ba/testWithMapReduceSingleRegion/4ad0f02a-942c-4664-a22a-c8a0832a8c65 2023-02-13 20:04:12,893 DEBUG [Listener at localhost/33573] util.CommonFSUtils(699): |-data/ 2023-02-13 20:04:12,893 DEBUG [Listener at localhost/33573] util.CommonFSUtils(699): |----default/ 2023-02-13 20:04:12,894 DEBUG [Listener at localhost/33573] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 20:04:12,894 DEBUG [Listener at localhost/33573] util.CommonFSUtils(699): |----------e450b2adea4f519baa983c406c6b0f75/ 2023-02-13 20:04:12,894 DEBUG [Listener at localhost/33573] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 20:04:12,894 DEBUG [Listener at localhost/33573] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 20:04:12,895 DEBUG [Listener at localhost/33573] util.CommonFSUtils(702): |----------------testWithMapReduce=e450b2adea4f519baa983c406c6b0f75-82342adfabd042ebb97e259c5ab26c3e 2023-02-13 20:04:12,895 DEBUG [Listener at localhost/33573] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 20:04:12,895 DEBUG [Listener at localhost/33573] util.CommonFSUtils(702): |----------------testWithMapReduce=e450b2adea4f519baa983c406c6b0f75-53f22d8b83d24fb5bd4afc1482892fbd 2023-02-13 20:04:12,895 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,896 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,896 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,897 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,897 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,897 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,897 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,963 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/hadoop-5117338156722196440.jar 2023-02-13 20:04:12,964 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,964 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,964 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,964 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,965 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,965 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,965 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 20:04:12,966 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 20:04:12,966 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 20:04:12,966 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 20:04:12,967 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 20:04:12,967 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 20:04:12,967 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 20:04:12,968 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 20:04:12,968 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 20:04:12,968 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 20:04:12,969 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 20:04:12,969 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 20:04:12,969 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 20:04:12,970 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 20:04:12,970 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 20:04:13,036 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/hadoop-6554108476782075070.jar 2023-02-13 20:04:13,036 DEBUG [Listener at localhost/33573] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 20:04:13,042 WARN [Listener at localhost/33573] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 20:04:13,073 INFO [Listener at localhost/33573] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 20:04:13,159 WARN [Listener at localhost/33573] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/mapreduce.cluster.local.dir/1676318653124/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 20:04:13,159 WARN [Listener at localhost/33573] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/mapreduce.cluster.local.dir/1676318653124/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 20:04:13,191 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 20:04:13,191 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 20:04:13,191 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 20:04:13,193 INFO [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:13,194 DEBUG [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/570a6248-b114-07a1-0c6f-635e7ccb23ba/testWithMapReduceSingleRegion/4ad0f02a-942c-4664-a22a-c8a0832a8c65/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1 2023-02-13 20:04:13,195 INFO [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e450b2adea4f519baa983c406c6b0f75 columnFamilyName f1 2023-02-13 20:04:13,199 DEBUG [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] regionserver.HStore(539): loaded hdfs://localhost:34861/user/jenkins/test-data/570a6248-b114-07a1-0c6f-635e7ccb23ba/testWithMapReduceSingleRegion/4ad0f02a-942c-4664-a22a-c8a0832a8c65/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1/testWithMapReduce=e450b2adea4f519baa983c406c6b0f75-82342adfabd042ebb97e259c5ab26c3e 2023-02-13 20:04:13,199 INFO [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] regionserver.HStore(310): Store=e450b2adea4f519baa983c406c6b0f75/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:13,199 INFO [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:13,200 DEBUG [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34861/user/jenkins/test-data/570a6248-b114-07a1-0c6f-635e7ccb23ba/testWithMapReduceSingleRegion/4ad0f02a-942c-4664-a22a-c8a0832a8c65/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2 2023-02-13 20:04:13,200 INFO [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e450b2adea4f519baa983c406c6b0f75 columnFamilyName f2 2023-02-13 20:04:13,204 DEBUG [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] regionserver.HStore(539): loaded hdfs://localhost:34861/user/jenkins/test-data/570a6248-b114-07a1-0c6f-635e7ccb23ba/testWithMapReduceSingleRegion/4ad0f02a-942c-4664-a22a-c8a0832a8c65/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2/testWithMapReduce=e450b2adea4f519baa983c406c6b0f75-53f22d8b83d24fb5bd4afc1482892fbd 2023-02-13 20:04:13,204 INFO [StoreOpener-e450b2adea4f519baa983c406c6b0f75-1] regionserver.HStore(310): Store=e450b2adea4f519baa983c406c6b0f75/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 20:04:13,204 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 20:04:13,205 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e450b2adea4f519baa983c406c6b0f75; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71069905, jitterRate=0.059024110436439514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 20:04:13,205 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e450b2adea4f519baa983c406c6b0f75: Writing region info on filesystem at 1676318653191Initializing all the Stores at 1676318653192 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318653192Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676318653192Region opened successfully at 1676318653205 (+13 ms) 2023-02-13 20:04:13,345 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e450b2adea4f519baa983c406c6b0f75, disabling compactions & flushes 2023-02-13 20:04:13,345 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:13,345 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:13,345 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. after waiting 0 ms 2023-02-13 20:04:13,346 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:13,346 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:13,346 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e450b2adea4f519baa983c406c6b0f75: Waiting for close lock at 1676318653345Disabling compacts and flushes for region at 1676318653345Disabling writes for close at 1676318653346 (+1 ms)Writing region close event to WAL at 1676318653346Closed at 1676318653346 2023-02-13 20:04:14,193 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-13 20:04:14,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-13 20:04:14,196 INFO [Listener at localhost/33573] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 20:04:14,196 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 20:04:14,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-13 20:04:14,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 20:04:14,199 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318654199"}]},"ts":"1676318654199"} 2023-02-13 20:04:14,201 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-13 20:04:14,202 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-13 20:04:14,203 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e450b2adea4f519baa983c406c6b0f75, UNASSIGN}] 2023-02-13 20:04:14,203 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e450b2adea4f519baa983c406c6b0f75, UNASSIGN 2023-02-13 20:04:14,204 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e450b2adea4f519baa983c406c6b0f75, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:14,204 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676318654204"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676318654204"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676318654204"}]},"ts":"1676318654204"} 2023-02-13 20:04:14,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure e450b2adea4f519baa983c406c6b0f75, server=jenkins-hbase4.apache.org,38529,1676318650334}] 2023-02-13 20:04:14,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 20:04:14,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:14,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e450b2adea4f519baa983c406c6b0f75, disabling compactions & flushes 2023-02-13 20:04:14,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:14,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:14,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. after waiting 0 ms 2023-02-13 20:04:14,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:14,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 20:04:14,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75. 2023-02-13 20:04:14,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e450b2adea4f519baa983c406c6b0f75: Waiting for close lock at 1676318654357Running coprocessor pre-close hooks at 1676318654357Disabling compacts and flushes for region at 1676318654357Disabling writes for close at 1676318654358 (+1 ms)Writing region close event to WAL at 1676318654358Running coprocessor post-close hooks at 1676318654362 (+4 ms)Closed at 1676318654363 (+1 ms) 2023-02-13 20:04:14,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:14,365 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e450b2adea4f519baa983c406c6b0f75, regionState=CLOSED 2023-02-13 20:04:14,365 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676318654365"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676318654365"}]},"ts":"1676318654365"} 2023-02-13 20:04:14,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 20:04:14,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure e450b2adea4f519baa983c406c6b0f75, server=jenkins-hbase4.apache.org,38529,1676318650334 in 161 msec 2023-02-13 20:04:14,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 20:04:14,369 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e450b2adea4f519baa983c406c6b0f75, UNASSIGN in 164 msec 2023-02-13 20:04:14,369 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676318654369"}]},"ts":"1676318654369"} 2023-02-13 20:04:14,370 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-13 20:04:14,372 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-13 20:04:14,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 176 msec 2023-02-13 20:04:14,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 20:04:14,502 INFO [Listener at localhost/33573] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-13 20:04:14,502 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-13 20:04:14,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-13 20:04:14,505 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 20:04:14,506 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 20:04:14,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 20:04:14,509 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:14,511 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1, FileablePath, hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2, FileablePath, hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/recovered.edits] 2023-02-13 20:04:14,514 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1/82342adfabd042ebb97e259c5ab26c3e to hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/archive/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1/82342adfabd042ebb97e259c5ab26c3e 2023-02-13 20:04:14,515 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1/a7802fce1b10452b947fec623e9f8058 to hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/archive/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f1/a7802fce1b10452b947fec623e9f8058 2023-02-13 20:04:14,518 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2/154f9da3781e409697b586d42be7a14c to hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/archive/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2/154f9da3781e409697b586d42be7a14c 2023-02-13 20:04:14,519 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2/53f22d8b83d24fb5bd4afc1482892fbd to hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/archive/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/f2/53f22d8b83d24fb5bd4afc1482892fbd 2023-02-13 20:04:14,522 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/recovered.edits/12.seqid to hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/archive/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75/recovered.edits/12.seqid 2023-02-13 20:04:14,522 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/.tmp/data/default/testWithMapReduce/e450b2adea4f519baa983c406c6b0f75 2023-02-13 20:04:14,522 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 20:04:14,524 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 20:04:14,526 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-13 20:04:14,528 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-13 20:04:14,529 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 20:04:14,529 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-13 20:04:14,529 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676318654529"}]},"ts":"9223372036854775807"} 2023-02-13 20:04:14,530 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 20:04:14,530 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e450b2adea4f519baa983c406c6b0f75, NAME => 'testWithMapReduce,,1676318651363.e450b2adea4f519baa983c406c6b0f75.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 20:04:14,530 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-13 20:04:14,530 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676318654530"}]},"ts":"9223372036854775807"} 2023-02-13 20:04:14,531 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-13 20:04:14,533 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 20:04:14,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 31 msec 2023-02-13 20:04:14,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33867] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 20:04:14,607 INFO [Listener at localhost/33573] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-13 20:04:14,608 INFO [Listener at localhost/33573] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 20:04:14,608 INFO [Listener at localhost/33573] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 20:04:14,608 DEBUG [Listener at localhost/33573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58aaaced to 127.0.0.1:61635 2023-02-13 20:04:14,608 DEBUG [Listener at localhost/33573] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:14,608 DEBUG [Listener at localhost/33573] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 20:04:14,608 DEBUG [Listener at localhost/33573] util.JVMClusterUtil(257): Found active master hash=1719971551, stopped=false 2023-02-13 20:04:14,608 INFO [Listener at localhost/33573] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33867,1676318650263 2023-02-13 20:04:14,611 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:14,611 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:14,611 INFO [Listener at localhost/33573] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 20:04:14,611 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 20:04:14,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:14,611 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:14,613 DEBUG [Listener at localhost/33573] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x412abb22 to 127.0.0.1:61635 2023-02-13 20:04:14,612 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:14,613 DEBUG [Listener at localhost/33573] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:14,614 INFO [Listener at localhost/33573] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41699,1676318650308' ***** 2023-02-13 20:04:14,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 20:04:14,614 INFO [Listener at localhost/33573] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:04:14,614 INFO [Listener at localhost/33573] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38529,1676318650334' ***** 2023-02-13 20:04:14,614 INFO [RS:0;jenkins-hbase4:41699] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:04:14,614 INFO [Listener at localhost/33573] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 20:04:14,614 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:04:14,614 INFO [RS:0;jenkins-hbase4:41699] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:04:14,615 INFO [RS:1;jenkins-hbase4:38529] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 20:04:14,615 INFO [RS:0;jenkins-hbase4:41699] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:04:14,615 INFO [RS:1;jenkins-hbase4:38529] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 20:04:14,615 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 20:04:14,615 INFO [RS:0;jenkins-hbase4:41699] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:14,615 INFO [RS:1;jenkins-hbase4:38529] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 20:04:14,616 DEBUG [RS:0;jenkins-hbase4:41699] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b415335 to 127.0.0.1:61635 2023-02-13 20:04:14,616 INFO [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(3304): Received CLOSE for b056cf84f28f4ae9b2a54504b439e210 2023-02-13 20:04:14,616 DEBUG [RS:0;jenkins-hbase4:41699] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:14,616 INFO [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:14,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b056cf84f28f4ae9b2a54504b439e210, disabling compactions & flushes 2023-02-13 20:04:14,616 DEBUG [RS:1;jenkins-hbase4:38529] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x604a0993 to 127.0.0.1:61635 2023-02-13 20:04:14,616 INFO [RS:0;jenkins-hbase4:41699] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41699,1676318650308; all regions closed. 2023-02-13 20:04:14,616 DEBUG [RS:1;jenkins-hbase4:38529] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:14,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. 2023-02-13 20:04:14,616 INFO [RS:1;jenkins-hbase4:38529] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:04:14,617 INFO [RS:1;jenkins-hbase4:38529] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:04:14,617 INFO [RS:1;jenkins-hbase4:38529] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:04:14,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. 2023-02-13 20:04:14,617 INFO [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 20:04:14,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. after waiting 0 ms 2023-02-13 20:04:14,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. 2023-02-13 20:04:14,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing b056cf84f28f4ae9b2a54504b439e210 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 20:04:14,617 INFO [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-13 20:04:14,617 DEBUG [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, b056cf84f28f4ae9b2a54504b439e210=hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210.} 2023-02-13 20:04:14,617 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 20:04:14,617 DEBUG [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1505): Waiting on 1588230740, b056cf84f28f4ae9b2a54504b439e210 2023-02-13 20:04:14,617 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 20:04:14,617 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 20:04:14,617 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 20:04:14,617 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 20:04:14,617 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-13 20:04:14,621 DEBUG [RS:0;jenkins-hbase4:41699] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/oldWALs 2023-02-13 20:04:14,621 INFO [RS:0;jenkins-hbase4:41699] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41699%2C1676318650308:(num 1676318651630) 2023-02-13 20:04:14,621 DEBUG [RS:0;jenkins-hbase4:41699] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:14,621 INFO [RS:0;jenkins-hbase4:41699] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:04:14,621 INFO [RS:0;jenkins-hbase4:41699] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 20:04:14,621 INFO [RS:0;jenkins-hbase4:41699] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 20:04:14,621 INFO [RS:0;jenkins-hbase4:41699] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 20:04:14,621 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:04:14,621 INFO [RS:0;jenkins-hbase4:41699] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 20:04:14,622 INFO [RS:0;jenkins-hbase4:41699] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41699 2023-02-13 20:04:14,623 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:14,624 ERROR [Listener at localhost/33573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a2d3743 rejected from java.util.concurrent.ThreadPoolExecutor@e12a2de[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:14,624 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:14,624 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:14,624 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41699,1676318650308 2023-02-13 20:04:14,624 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:14,624 ERROR [Listener at localhost/33573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@19e53a0d rejected from java.util.concurrent.ThreadPoolExecutor@e12a2de[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:14,625 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41699,1676318650308] 2023-02-13 20:04:14,625 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41699,1676318650308; numProcessing=1 2023-02-13 20:04:14,626 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41699,1676318650308 already deleted, retry=false 2023-02-13 20:04:14,626 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41699,1676318650308 expired; onlineServers=1 2023-02-13 20:04:14,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/namespace/b056cf84f28f4ae9b2a54504b439e210/.tmp/info/74f854893822485cbe0e743e26b847c2 2023-02-13 20:04:14,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/namespace/b056cf84f28f4ae9b2a54504b439e210/.tmp/info/74f854893822485cbe0e743e26b847c2 as hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/namespace/b056cf84f28f4ae9b2a54504b439e210/info/74f854893822485cbe0e743e26b847c2 2023-02-13 20:04:14,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/namespace/b056cf84f28f4ae9b2a54504b439e210/info/74f854893822485cbe0e743e26b847c2, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 20:04:14,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b056cf84f28f4ae9b2a54504b439e210 in 18ms, sequenceid=6, compaction requested=false 2023-02-13 20:04:14,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/namespace/b056cf84f28f4ae9b2a54504b439e210/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 20:04:14,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. 2023-02-13 20:04:14,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b056cf84f28f4ae9b2a54504b439e210: Waiting for close lock at 1676318654616Running coprocessor pre-close hooks at 1676318654616Disabling compacts and flushes for region at 1676318654616Disabling writes for close at 1676318654617 (+1 ms)Obtaining lock to block concurrent updates at 1676318654617Preparing flush snapshotting stores in b056cf84f28f4ae9b2a54504b439e210 at 1676318654617Finished memstore snapshotting hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676318654617Flushing stores of hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. at 1676318654617Flushing b056cf84f28f4ae9b2a54504b439e210/info: creating writer at 1676318654618 (+1 ms)Flushing b056cf84f28f4ae9b2a54504b439e210/info: appending metadata at 1676318654621 (+3 ms)Flushing b056cf84f28f4ae9b2a54504b439e210/info: closing flushed file at 1676318654621Flushing b056cf84f28f4ae9b2a54504b439e210/info: reopening flushed file at 1676318654631 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b056cf84f28f4ae9b2a54504b439e210 in 18ms, sequenceid=6, compaction requested=false at 1676318654635 (+4 ms)Writing region close event to WAL at 1676318654635Running coprocessor post-close hooks at 1676318654637 (+2 ms)Closed at 1676318654638 (+1 ms) 2023-02-13 20:04:14,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676318650897.b056cf84f28f4ae9b2a54504b439e210. 2023-02-13 20:04:14,672 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:04:14,672 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:04:14,811 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:14,811 INFO [RS:0;jenkins-hbase4:41699] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41699,1676318650308; zookeeper connection closed. 2023-02-13 20:04:14,811 ERROR [Listener at localhost/33573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@618ec883 rejected from java.util.concurrent.ThreadPoolExecutor@e12a2de[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:14,811 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@43e38b34] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@43e38b34 2023-02-13 20:04:14,811 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:41699-0x1004f4899480001, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:14,811 ERROR [Listener at localhost/33573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bbaa00f rejected from java.util.concurrent.ThreadPoolExecutor@e12a2de[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:14,817 DEBUG [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 20:04:15,017 DEBUG [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 20:04:15,028 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/.tmp/info/7592b4a15dbb49709c7d951b819f4bae 2023-02-13 20:04:15,032 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7592b4a15dbb49709c7d951b819f4bae 2023-02-13 20:04:15,039 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/.tmp/rep_barrier/3216b22a52b1441ab403d69e4252eb54 2023-02-13 20:04:15,042 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3216b22a52b1441ab403d69e4252eb54 2023-02-13 20:04:15,052 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/.tmp/table/0c8e4377663449e88f296b63a9274658 2023-02-13 20:04:15,055 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c8e4377663449e88f296b63a9274658 2023-02-13 20:04:15,056 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/.tmp/info/7592b4a15dbb49709c7d951b819f4bae as hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/info/7592b4a15dbb49709c7d951b819f4bae 2023-02-13 20:04:15,059 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7592b4a15dbb49709c7d951b819f4bae 2023-02-13 20:04:15,059 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/info/7592b4a15dbb49709c7d951b819f4bae, entries=12, sequenceid=21, filesize=6.2 K 2023-02-13 20:04:15,060 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/.tmp/rep_barrier/3216b22a52b1441ab403d69e4252eb54 as hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/rep_barrier/3216b22a52b1441ab403d69e4252eb54 2023-02-13 20:04:15,063 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3216b22a52b1441ab403d69e4252eb54 2023-02-13 20:04:15,063 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/rep_barrier/3216b22a52b1441ab403d69e4252eb54, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 20:04:15,063 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/.tmp/table/0c8e4377663449e88f296b63a9274658 as hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/table/0c8e4377663449e88f296b63a9274658 2023-02-13 20:04:15,066 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c8e4377663449e88f296b63a9274658 2023-02-13 20:04:15,066 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/table/0c8e4377663449e88f296b63a9274658, entries=4, sequenceid=21, filesize=5.0 K 2023-02-13 20:04:15,067 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 450ms, sequenceid=21, compaction requested=false 2023-02-13 20:04:15,070 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 20:04:15,070 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 20:04:15,072 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 20:04:15,072 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676318654617Running coprocessor pre-close hooks at 1676318654617Disabling compacts and flushes for region at 1676318654617Disabling writes for close at 1676318654617Obtaining lock to block concurrent updates at 1676318654617Preparing flush snapshotting stores in 1588230740 at 1676318654617Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676318654618 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676318654619 (+1 ms)Flushing 1588230740/info: creating writer at 1676318654619Flushing 1588230740/info: appending metadata at 1676318654621 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676318654621Flushing 1588230740/rep_barrier: creating writer at 1676318655032 (+411 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676318655034 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676318655034Flushing 1588230740/table: creating writer at 1676318655042 (+8 ms)Flushing 1588230740/table: appending metadata at 1676318655044 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676318655044Flushing 1588230740/info: reopening flushed file at 1676318655056 (+12 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676318655060 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676318655064 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 450ms, sequenceid=21, compaction requested=false at 1676318655067 (+3 ms)Writing region close event to WAL at 1676318655068 (+1 ms)Running coprocessor post-close hooks at 1676318655070 (+2 ms)Closed at 1676318655072 (+2 ms) 2023-02-13 20:04:15,072 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 20:04:15,218 INFO [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38529,1676318650334; all regions closed. 2023-02-13 20:04:15,224 DEBUG [RS:1;jenkins-hbase4:38529] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/oldWALs 2023-02-13 20:04:15,224 INFO [RS:1;jenkins-hbase4:38529] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38529%2C1676318650334.meta:.meta(num 1676318650844) 2023-02-13 20:04:15,227 DEBUG [RS:1;jenkins-hbase4:38529] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/oldWALs 2023-02-13 20:04:15,228 INFO [RS:1;jenkins-hbase4:38529] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38529%2C1676318650334:(num 1676318651239) 2023-02-13 20:04:15,228 DEBUG [RS:1;jenkins-hbase4:38529] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:15,228 INFO [RS:1;jenkins-hbase4:38529] regionserver.LeaseManager(133): Closed leases 2023-02-13 20:04:15,228 INFO [RS:1;jenkins-hbase4:38529] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 20:04:15,228 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:04:15,230 INFO [RS:1;jenkins-hbase4:38529] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38529 2023-02-13 20:04:15,232 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38529,1676318650334 2023-02-13 20:04:15,232 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 20:04:15,232 ERROR [Listener at localhost/33573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@32517f60 rejected from java.util.concurrent.ThreadPoolExecutor@366efdf2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:15,233 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38529,1676318650334] 2023-02-13 20:04:15,233 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38529,1676318650334; numProcessing=2 2023-02-13 20:04:15,234 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38529,1676318650334 already deleted, retry=false 2023-02-13 20:04:15,234 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38529,1676318650334 expired; onlineServers=0 2023-02-13 20:04:15,234 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33867,1676318650263' ***** 2023-02-13 20:04:15,235 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 20:04:15,235 DEBUG [M:0;jenkins-hbase4:33867] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62bb36d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 20:04:15,235 INFO [M:0;jenkins-hbase4:33867] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33867,1676318650263 2023-02-13 20:04:15,235 INFO [M:0;jenkins-hbase4:33867] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33867,1676318650263; all regions closed. 2023-02-13 20:04:15,235 DEBUG [M:0;jenkins-hbase4:33867] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 20:04:15,235 DEBUG [M:0;jenkins-hbase4:33867] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 20:04:15,235 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 20:04:15,235 DEBUG [M:0;jenkins-hbase4:33867] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 20:04:15,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318650490] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676318650490,5,FailOnTimeoutGroup] 2023-02-13 20:04:15,236 INFO [M:0;jenkins-hbase4:33867] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 20:04:15,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318650490] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676318650490,5,FailOnTimeoutGroup] 2023-02-13 20:04:15,236 INFO [M:0;jenkins-hbase4:33867] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 20:04:15,237 INFO [M:0;jenkins-hbase4:33867] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 20:04:15,237 DEBUG [M:0;jenkins-hbase4:33867] master.HMaster(1502): Stopping service threads 2023-02-13 20:04:15,237 INFO [M:0;jenkins-hbase4:33867] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 20:04:15,238 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 20:04:15,238 ERROR [M:0;jenkins-hbase4:33867] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 20:04:15,238 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 20:04:15,238 INFO [M:0;jenkins-hbase4:33867] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 20:04:15,238 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 20:04:15,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 20:04:15,238 DEBUG [M:0;jenkins-hbase4:33867] zookeeper.ZKUtil(398): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 20:04:15,238 WARN [M:0;jenkins-hbase4:33867] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 20:04:15,238 INFO [M:0;jenkins-hbase4:33867] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 20:04:15,239 INFO [M:0;jenkins-hbase4:33867] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 20:04:15,239 DEBUG [M:0;jenkins-hbase4:33867] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 20:04:15,239 INFO [M:0;jenkins-hbase4:33867] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:15,239 DEBUG [M:0;jenkins-hbase4:33867] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:15,239 DEBUG [M:0;jenkins-hbase4:33867] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 20:04:15,239 DEBUG [M:0;jenkins-hbase4:33867] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:15,239 INFO [M:0;jenkins-hbase4:33867] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.68 KB heapSize=65.67 KB 2023-02-13 20:04:15,254 INFO [M:0;jenkins-hbase4:33867] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.68 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6d92aa7d8fa446f38ef09afd3922f03d 2023-02-13 20:04:15,257 DEBUG [M:0;jenkins-hbase4:33867] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6d92aa7d8fa446f38ef09afd3922f03d as hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6d92aa7d8fa446f38ef09afd3922f03d 2023-02-13 20:04:15,261 INFO [M:0;jenkins-hbase4:33867] regionserver.HStore(1080): Added hdfs://localhost:34861/user/jenkins/test-data/4d1b8388-6171-5c12-9040-c1d826152227/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6d92aa7d8fa446f38ef09afd3922f03d, entries=17, sequenceid=132, filesize=8.6 K 2023-02-13 20:04:15,261 INFO [M:0;jenkins-hbase4:33867] regionserver.HRegion(2947): Finished flush of dataSize ~54.68 KB/55994, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=132, compaction requested=false 2023-02-13 20:04:15,262 INFO [M:0;jenkins-hbase4:33867] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 20:04:15,262 DEBUG [M:0;jenkins-hbase4:33867] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676318655239Disabling compacts and flushes for region at 1676318655239Disabling writes for close at 1676318655239Obtaining lock to block concurrent updates at 1676318655239Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676318655239Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=55994, getHeapSize=67232, getOffHeapSize=0, getCellsCount=145 at 1676318655239Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676318655240 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676318655240Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676318655242 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676318655242Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676318655258 (+16 ms)Finished flush of dataSize ~54.68 KB/55994, heapSize ~65.66 KB/67232, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=132, compaction requested=false at 1676318655261 (+3 ms)Writing region close event to WAL at 1676318655262 (+1 ms)Closed at 1676318655262 2023-02-13 20:04:15,264 INFO [M:0;jenkins-hbase4:33867] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 20:04:15,264 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 20:04:15,264 INFO [M:0;jenkins-hbase4:33867] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33867 2023-02-13 20:04:15,266 DEBUG [M:0;jenkins-hbase4:33867] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33867,1676318650263 already deleted, retry=false 2023-02-13 20:04:15,334 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:15,334 INFO [RS:1;jenkins-hbase4:38529] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38529,1676318650334; zookeeper connection closed. 2023-02-13 20:04:15,334 ERROR [Listener at localhost/33573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7b46df32 rejected from java.util.concurrent.ThreadPoolExecutor@366efdf2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:15,334 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): regionserver:38529-0x1004f4899480002, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:15,334 ERROR [Listener at localhost/33573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@395f190 rejected from java.util.concurrent.ThreadPoolExecutor@366efdf2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:15,334 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@64feb4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@64feb4 2023-02-13 20:04:15,334 INFO [Listener at localhost/33573] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 20:04:15,434 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:15,434 INFO [M:0;jenkins-hbase4:33867] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33867,1676318650263; zookeeper connection closed. 2023-02-13 20:04:15,434 ERROR [Listener at localhost/33573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@722d7038 rejected from java.util.concurrent.ThreadPoolExecutor@7612faa5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:15,435 DEBUG [Listener at localhost/33573-EventThread] zookeeper.ZKWatcher(600): master:33867-0x1004f4899480000, quorum=127.0.0.1:61635, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 20:04:15,435 ERROR [Listener at localhost/33573-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bdc218d rejected from java.util.concurrent.ThreadPoolExecutor@7612faa5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 20:04:15,435 WARN [Listener at localhost/33573] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:04:15,442 INFO [Listener at localhost/33573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:04:15,546 WARN [BP-134091877-172.31.14.131-1676318649682 heartbeating to localhost/127.0.0.1:34861] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 20:04:15,546 WARN [BP-134091877-172.31.14.131-1676318649682 heartbeating to localhost/127.0.0.1:34861] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-134091877-172.31.14.131-1676318649682 (Datanode Uuid 9f5bcb0e-11a5-402b-94d3-500761990d9e) service to localhost/127.0.0.1:34861 2023-02-13 20:04:15,547 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/cluster_4a7dd576-706a-84ab-1843-da8ad116c65c/dfs/data/data3/current/BP-134091877-172.31.14.131-1676318649682] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:15,547 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/cluster_4a7dd576-706a-84ab-1843-da8ad116c65c/dfs/data/data4/current/BP-134091877-172.31.14.131-1676318649682] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:15,549 WARN [Listener at localhost/33573] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 20:04:15,553 INFO [Listener at localhost/33573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:04:15,654 WARN [BP-134091877-172.31.14.131-1676318649682 heartbeating to localhost/127.0.0.1:34861] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 20:04:15,654 WARN [BP-134091877-172.31.14.131-1676318649682 heartbeating to localhost/127.0.0.1:34861] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-134091877-172.31.14.131-1676318649682 (Datanode Uuid a62fdac7-9799-4e8e-ad28-506bd7851daf) service to localhost/127.0.0.1:34861 2023-02-13 20:04:15,655 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/cluster_4a7dd576-706a-84ab-1843-da8ad116c65c/dfs/data/data1/current/BP-134091877-172.31.14.131-1676318649682] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:15,656 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2437a015-d035-ce37-e64b-a18b6037954e/cluster_4a7dd576-706a-84ab-1843-da8ad116c65c/dfs/data/data2/current/BP-134091877-172.31.14.131-1676318649682] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 20:04:15,665 INFO [Listener at localhost/33573] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 20:04:15,777 INFO [Listener at localhost/33573] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 20:04:15,802 INFO [Listener at localhost/33573] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 20:04:15,816 INFO [Listener at localhost/33573] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=291 (was 272) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33573 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:34861 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:34861 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:34861 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:34861 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34861 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:34861 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,33867,1676318650263)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (36597544) connection to localhost/127.0.0.1:34861 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=601 (was 582) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=301 (was 319), ProcessCount=165 (was 166), AvailableMemoryMB=1312 (was 1425)